Nov 14 02:01:44 user nova-compute[75257]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75257) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75257) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75257) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 02:01:44 user nova-compute[75257]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:01:44 user nova-compute[75257]: INFO nova.virt.driver [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 02:01:44 user nova-compute[75257]: INFO nova.compute.provider_config [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] Acquiring lock "singleton_lock" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] Acquired lock "singleton_lock" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] Releasing lock "singleton_lock" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] Full set of CONF: {{(pid=75257) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ******************************************************************************** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] Configuration options gathered from: {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ================================================================================ {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] allow_resize_to_same_host      = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] arq_binding_timeout            = 300 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] backdoor_port                  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] backdoor_socket                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] block_device_allocate_retries  = 300 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] block_device_allocate_retries_interval = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cert                           = self.pem {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute_monitors               = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] config_dir                     = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] config_drive_format            = iso9660 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] config_source                  = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] console_host                   = user {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] control_exchange               = nova {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cpu_allocation_ratio           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] daemon                         = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] debug                          = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] default_access_ip_network_name = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] default_availability_zone      = nova {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] default_ephemeral_format       = ext4 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] default_green_pool_size        = 1000 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] default_schedule_zone          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] disk_allocation_ratio          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] enable_new_services            = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] enabled_ssl_apis               = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] flat_injected                  = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] force_config_drive             = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] force_raw_images               = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] graceful_shutdown_timeout      = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] heal_instance_info_cache_interval = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] host                           = user {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] instance_build_timeout         = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] instance_delete_interval       = 300 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] instance_name_template         = instance-%08x {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] instance_usage_audit           = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] instance_usage_audit_period    = month {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] internal_service_availability_zone = internal {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] key                            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] live_migration_retry_count     = 30 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] log_config_append              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] log_dir                        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] log_file                       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] log_options                    = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] log_rotate_interval            = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] log_rotate_interval_type       = days {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] log_rotation_type              = none {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] long_rpc_timeout               = 1800 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] max_concurrent_builds          = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] max_concurrent_live_migrations = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] max_concurrent_snapshots       = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] max_local_block_devices        = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] max_logfile_count              = 30 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] max_logfile_size_mb            = 200 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] maximum_instance_delete_attempts = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] metadata_listen                = 0.0.0.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] metadata_listen_port           = 8775 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] metadata_workers               = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] migrate_max_retries            = -1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] mkisofs_cmd                    = genisoimage {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] my_ip                          = 10.0.0.210 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] network_allocate_retries       = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] osapi_compute_listen_port      = 8774 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] osapi_compute_unique_server_name_scope =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] osapi_compute_workers          = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] password_length                = 12 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] periodic_enable                = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] periodic_fuzzy_delay           = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] pointer_model                  = ps2mouse {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] preallocate_images             = none {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] publish_errors                 = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] pybasedir                      = /opt/stack/nova {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ram_allocation_ratio           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] rate_limit_burst               = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] rate_limit_except_level        = CRITICAL {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] rate_limit_interval            = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] reboot_timeout                 = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] reclaim_instance_interval      = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] record                         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] reimage_timeout_per_gb         = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] report_interval                = 120 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] rescue_timeout                 = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] reserved_host_cpus             = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] reserved_host_disk_mb          = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] reserved_host_memory_mb        = 512 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] reserved_huge_pages            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] resize_confirm_window          = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] resize_fs_using_block_device   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] resume_guests_state_on_host_boot = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] rpc_response_timeout           = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] run_external_periodic_tasks    = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] running_deleted_instance_action = reap {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] running_deleted_instance_timeout = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler_instance_sync_interval = 120 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_down_time              = 720 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] servicegroup_driver            = db {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] shelved_offload_time           = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] shelved_poll_interval          = 3600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] shutdown_timeout               = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] source_is_ipv6                 = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ssl_only                       = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] state_path                     = /opt/stack/data/nova {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] sync_power_state_interval      = 600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] sync_power_state_pool_size     = 1000 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] syslog_log_facility            = LOG_USER {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] tempdir                        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] timeout_nbd                    = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] transport_url                  = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] update_resources_interval      = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] use_cow_images                 = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] use_eventlog                   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] use_journal                    = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] use_json                       = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] use_rootwrap_daemon            = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] use_stderr                     = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] use_syslog                     = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vcpu_pin_set                   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plugging_is_fatal          = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plugging_timeout           = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] virt_mkfs                      = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] volume_usage_poll_interval     = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] watch_log_file                 = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] web                            = /usr/share/spice-html5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_concurrency.disable_process_locking = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:44 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.auth_strategy              = keystone {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.compute_link_prefix        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.dhcp_domain                = novalocal {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.enable_instance_password   = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.glance_link_prefix         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.instance_list_per_project_cells = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.list_records_by_skipping_down_cells = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.local_metadata_per_cell    = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.max_limit                  = 1000 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.metadata_cache_expiration  = 15 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.neutron_default_tenant_id  = default {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.use_forwarded_for          = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.use_neutron_default_nets   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.vendordata_dynamic_targets = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.vendordata_jsonfile_path   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.backend_argument         = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.config_prefix            = cache.oslo {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.dead_timeout             = 60.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.debug_cache_backend      = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.enable_retry_client      = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.enable_socket_keepalive  = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.enabled                  = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.expiration_time          = 600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.hashclient_retry_attempts = 2 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_dead_retry      = 300 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_password        =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_sasl_enabled    = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.memcache_username        =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.proxies                  = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.retry_attempts           = 2 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.retry_delay              = 0.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.socket_keepalive_count   = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.socket_keepalive_idle    = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.socket_keepalive_interval = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.tls_allowed_ciphers      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.tls_cafile               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.tls_certfile             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.tls_enabled              = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cache.tls_keyfile              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.auth_section            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.auth_type               = password {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.cafile                  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.certfile                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.collect_timing          = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.cross_az_attach         = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.debug                   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.endpoint_template       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.http_retries            = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.insecure                = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.keyfile                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.os_region_name          = RegionOne {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.split_loggers           = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cinder.timeout                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.cpu_dedicated_set      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.cpu_shared_set         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.image_type_exclude_list = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.resource_provider_association_refresh = 300 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.shutdown_retry_interval = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] conductor.workers              = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] console.allowed_origins        = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] console.ssl_ciphers            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] console.ssl_minimum_version    = default {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] consoleauth.token_ttl          = 600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.cafile                  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.certfile                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.collect_timing          = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.connect_retries         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.connect_retry_delay     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.endpoint_override       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.insecure                = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.keyfile                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.max_version             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.min_version             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.region_name             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.service_name            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.service_type            = accelerator {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.split_loggers           = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.status_code_retries     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.status_code_retry_delay = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.timeout                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] cyborg.version                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.backend               = sqlalchemy {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.connection            = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.connection_debug      = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.connection_parameters =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.connection_recycle_time = 3600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.connection_trace      = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.db_inc_retry_interval = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.db_max_retries        = 20 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.db_max_retry_interval = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.db_retry_interval     = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.max_overflow          = 50 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.max_pool_size         = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.max_retries           = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.mysql_wsrep_sync_wait = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.pool_timeout          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.retry_interval        = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.slave_connection      = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] database.sqlite_synchronous    = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.backend           = sqlalchemy {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.connection        = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.connection_debug  = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.connection_parameters =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.connection_recycle_time = 3600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.connection_trace  = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.db_inc_retry_interval = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.db_max_retries    = 20 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.db_max_retry_interval = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.db_retry_interval = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.max_overflow      = 50 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.max_pool_size     = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.max_retries       = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.pool_timeout      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.retry_interval    = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.slave_connection  = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] api_database.sqlite_synchronous = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] devices.enabled_mdev_types     = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ephemeral_storage_encryption.enabled = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.api_servers             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.cafile                  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.certfile                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.collect_timing          = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.connect_retries         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.connect_retry_delay     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.debug                   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.default_trusted_certificate_ids = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.enable_certificate_validation = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.enable_rbd_download     = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.endpoint_override       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.insecure                = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.keyfile                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.max_version             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.min_version             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.num_retries             = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.rbd_ceph_conf           =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.rbd_connect_timeout     = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.rbd_pool                =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.rbd_user                =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.region_name             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.service_name            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.service_type            = image {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.split_loggers           = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.status_code_retries     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.status_code_retry_delay = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.timeout                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.verify_glance_signatures = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] glance.version                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] guestfs.debug                  = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.config_drive_cdrom      = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.config_drive_inject_password = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.enable_remotefx         = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.instances_path_share    =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.limit_cpu_features      = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.use_multipath_io        = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.vswitch_name            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] mks.enabled                    = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] image_cache.manager_interval   = 2400 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] image_cache.precache_concurrency = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] image_cache.remove_unused_base_images = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] image_cache.subdirectory_name  = _base {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.api_max_retries         = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.api_retry_interval      = 2 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.auth_section            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.auth_type               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.cafile                  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.certfile                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.collect_timing          = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.conductor_group         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.connect_retries         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.connect_retry_delay     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.endpoint_override       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.insecure                = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.keyfile                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.max_version             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.min_version             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.peer_list               = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.region_name             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.serial_console_state_timeout = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.service_name            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.service_type            = baremetal {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.split_loggers           = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.status_code_retries     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.status_code_retry_delay = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.timeout                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ironic.version                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] key_manager.fixed_key          = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.barbican_api_version  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.barbican_endpoint     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.barbican_endpoint_type = public {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.barbican_region_name  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.cafile                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.certfile              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.collect_timing        = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.insecure              = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.keyfile               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.number_of_retries     = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.retry_delay           = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.send_service_user_token = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.split_loggers         = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.timeout               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.verify_ssl            = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican.verify_ssl_path       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican_service_user.auth_section = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican_service_user.auth_type = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican_service_user.cafile   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican_service_user.certfile = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican_service_user.collect_timing = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican_service_user.insecure = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican_service_user.keyfile  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican_service_user.split_loggers = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] barbican_service_user.timeout  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.approle_role_id          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.approle_secret_id        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.cafile                   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.certfile                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.collect_timing           = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.insecure                 = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.keyfile                  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.kv_mountpoint            = secret {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.kv_path                  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.kv_version               = 2 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.namespace                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.root_token_id            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.split_loggers            = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.ssl_ca_crt_file          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.timeout                  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.use_ssl                  = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.auth_section          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.auth_type             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.cafile                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.certfile              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.collect_timing        = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.connect_retries       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.connect_retry_delay   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.endpoint_override     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.insecure              = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.keyfile               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.max_version           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.min_version           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.region_name           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.service_name          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.service_type          = identity {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.split_loggers         = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.status_code_retries   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.status_code_retry_delay = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.timeout               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] keystone.version               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.connection_uri         =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.cpu_mode               = custom {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: WARNING oslo_config.cfg [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.cpu_power_governor_high = performance {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.cpu_power_management   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.device_detach_attempts = 8 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.device_detach_timeout  = 20 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.disk_cachemodes        = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.disk_prefix            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.enabled_perf_events    = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.file_backed_memory     = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.gid_maps               = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.hw_disk_discard        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.hw_machine_type        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.images_rbd_pool        = rbd {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.images_type            = default {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.images_volume_group    = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.inject_key             = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.inject_partition       = -2 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.inject_password        = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.iscsi_iface            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.iser_use_multipath     = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_downtime = 500 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_inbound_addr = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_scheme  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_timeout_action = abort {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_tunnelled = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: WARNING oslo_config.cfg [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 02:01:45 user nova-compute[75257]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 02:01:45 user nova-compute[75257]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 02:01:45 user nova-compute[75257]: and ``live_migration_inbound_addr`` respectively.
Nov 14 02:01:45 user nova-compute[75257]: ).  Its value may be silently ignored in the future.
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.live_migration_with_native_tls = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.max_queues             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.nfs_mount_options      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.num_pcie_ports         = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.pmem_namespaces        = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.quobyte_client_cfg     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rbd_secret_uuid        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rbd_user               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rescue_image_id        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rescue_kernel_id       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.rx_queue_size          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.smbfs_mount_options    =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.snapshot_compression   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.snapshot_image_format  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.sparse_logical_volumes = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.swtpm_enabled          = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.swtpm_group            = tss {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.swtpm_user             = tss {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.sysinfo_serial         = unique {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.tb_cache_size          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.tx_queue_size          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.uid_maps               = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.use_virtio_for_bridges = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.virt_type              = kvm {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.volume_clear           = zero {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.volume_clear_size      = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.volume_use_multipath   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.vzstorage_cache_path   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.auth_section           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.auth_type              = password {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.cafile                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.certfile               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.collect_timing         = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.connect_retries        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.connect_retry_delay    = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.default_floating_pool  = public {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.endpoint_override      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.extension_sync_interval = 600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.http_retries           = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.insecure               = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.keyfile                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.max_version            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.min_version            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.ovs_bridge             = br-int {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.physnets               = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.region_name            = RegionOne {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.service_metadata_proxy = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.service_name           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.service_type           = network {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.split_loggers          = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.status_code_retries    = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.status_code_retry_delay = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.timeout                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] neutron.version                = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] notifications.bdms_in_notifications = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] notifications.default_level    = INFO {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] notifications.notification_format = unversioned {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] notifications.notify_on_state_change = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] pci.alias                      = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] pci.device_spec                = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] pci.report_in_placement        = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.auth_section         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.auth_type            = password {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.cafile               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.certfile             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.collect_timing       = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.connect_retries      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.connect_retry_delay  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.default_domain_id    = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.default_domain_name  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.domain_id            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.domain_name          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.endpoint_override    = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.insecure             = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.keyfile              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.max_version          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.min_version          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.password             = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.project_domain_id    = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.project_domain_name  = Default {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.project_id           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.project_name         = service {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.region_name          = RegionOne {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.service_name         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.service_type         = placement {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.split_loggers        = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.status_code_retries  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.status_code_retry_delay = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.system_scope         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.timeout              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.trust_id             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.user_domain_id       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.user_domain_name     = Default {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.user_id              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.username             = placement {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] placement.version              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.cores                    = 20 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.count_usage_from_placement = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.injected_file_content_bytes = 10240 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.injected_file_path_length = 255 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.injected_files           = 5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.instances                = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.key_pairs                = 100 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.metadata_items           = 128 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.ram                      = 51200 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.recheck_quota            = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.server_group_members     = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] quota.server_groups            = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] rdp.enabled                    = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.image_metadata_prefilter = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.max_attempts         = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.max_placement_results = 1000 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] scheduler.workers              = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.host_subset_size = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.isolated_hosts = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.isolated_images = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.pci_in_placement = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.track_instance_changes = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] metrics.required               = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] metrics.weight_multiplier      = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] metrics.weight_setting         = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] serial_console.enabled         = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] serial_console.port_range      = 10000:20000 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] serial_console.serialproxy_port = 6083 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.auth_section      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.auth_type         = password {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.cafile            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.certfile          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.collect_timing    = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.insecure          = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.keyfile           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.send_service_user_token = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.split_loggers     = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] service_user.timeout           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.agent_enabled            = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.enabled                  = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.html5proxy_port          = 6082 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.image_compression        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.jpeg_compression         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.playback_compression     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.server_listen            = 127.0.0.1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.streaming_mode           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] spice.zlib_compression         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] upgrade_levels.baseapi         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] upgrade_levels.cert            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] upgrade_levels.compute         = auto {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] upgrade_levels.conductor       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] upgrade_levels.scheduler       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vendordata_dynamic_auth.cafile = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vendordata_dynamic_auth.certfile = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vendordata_dynamic_auth.insecure = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vendordata_dynamic_auth.timeout = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.api_retry_count         = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.ca_file                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.cache_prefix            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.cluster_name            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.connection_pool_size    = 10 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.console_delay_seconds   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.datastore_regex         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.host_ip                 = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.host_password           = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.host_port               = 443 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.host_username           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.insecure                = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.integration_bridge      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.maximum_objects         = 100 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.pbm_default_policy      = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.pbm_enabled             = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.pbm_wsdl_location       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.serial_port_proxy_uri   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.serial_port_service_uri = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.task_poll_interval      = 0.5 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.use_linked_clone        = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.vnc_keymap              = en-us {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.vnc_port                = 5900 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vmware.vnc_port_total          = 10000 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.auth_schemes               = ['none'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.enabled                    = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.novncproxy_port            = 6080 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.vencrypt_ca_certs          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.vencrypt_client_cert       = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vnc.vencrypt_client_key        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.disable_rootwrap   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.enable_numa_live_migration = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.libvirt_disable_apic = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.client_socket_timeout     = 900 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.default_pool_size         = 1000 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.keep_alive                = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.max_header_line           = 16384 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.ssl_ca_file               = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.ssl_cert_file             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.ssl_key_file              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.tcp_keepidle              = 600 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] zvm.ca_file                    = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] zvm.cloud_connector_url        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] zvm.reachable_timeout          = 300 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.enforce_new_defaults = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.enforce_scope      = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.policy_default_rule = default {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.connection_string     = messaging:// {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.enabled               = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.es_doc_type           = notification {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.es_scroll_size        = 10000 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.es_scroll_time        = 2m {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.filter_error_trace    = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.hmac_keys             = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.sentinel_service_name = mymaster {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.socket_timeout        = 0.1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.trace_requests        = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler.trace_sqlalchemy      = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler_jaeger.process_tags   = {} {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler_jaeger.service_name_prefix = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] profiler_otlp.service_name_prefix = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] remote_debug.host              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] remote_debug.port              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_notifications.retry = -1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.auth_section        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.auth_type           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.cafile              = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.certfile            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.collect_timing      = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.connect_retries     = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.connect_retry_delay = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.endpoint_id         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.endpoint_override   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.insecure            = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.keyfile             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.max_version         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.min_version         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.region_name         = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.service_name        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.service_type        = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.split_loggers       = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.status_code_retries = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.status_code_retry_delay = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.timeout             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.valid_interfaces    = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_limit.version             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_reports.file_event_handler = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] oslo_reports.log_dir           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_ovs_privileged.group  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] vif_plug_ovs_privileged.user   = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_ovs.isolate_vif         = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] os_brick.lock_path             = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] privsep_osbrick.capabilities   = [21] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] privsep_osbrick.group          = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] privsep_osbrick.helper_command = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] privsep_osbrick.user           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] nova_sys_admin.group           = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] nova_sys_admin.helper_command  = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] nova_sys_admin.user            = None {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG oslo_service.service [None req-6addd4fd-49f0-4d85-916b-24ed8109d687 None None] ******************************************************************************** {{(pid=75257) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 02:01:45 user nova-compute[75257]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 02:01:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Connecting to libvirt: qemu:///system {{(pid=75257) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb9a57f6d70> {{(pid=75257) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 02:01:45 user nova-compute[75257]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 02:01:45 user nova-compute[75257]: WARNING nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 02:01:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb9a57f6d70> {{(pid=75257) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Starting native event thread {{(pid=75257) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Starting green dispatch thread {{(pid=75257) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 02:01:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Starting connection event dispatch thread {{(pid=75257) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 02:01:45 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Connection event '1' reason 'None'
Nov 14 02:01:45 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 02:01:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.mount [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Initialising _HostMountState generation 0 {{(pid=75257) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 02:01:52 user nova-compute[75257]: INFO nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt host capabilities <capabilities>
Nov 14 02:01:52 user nova-compute[75257]:   <host>
Nov 14 02:01:52 user nova-compute[75257]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 02:01:52 user nova-compute[75257]:     <cpu>
Nov 14 02:01:52 user nova-compute[75257]:       <arch>x86_64</arch>
Nov 14 02:01:52 user nova-compute[75257]:       <model>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <vendor>Intel</vendor>
Nov 14 02:01:52 user nova-compute[75257]:       <microcode version='1070'/>
Nov 14 02:01:52 user nova-compute[75257]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 02:01:52 user nova-compute[75257]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='ss'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='vmx'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='pcid'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='osxsave'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='hypervisor'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='arat'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='tsc_adjust'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='md-clear'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='arch-capabilities'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='invtsc'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='rsba'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 02:01:52 user nova-compute[75257]:       <pages unit='KiB' size='4'/>
Nov 14 02:01:52 user nova-compute[75257]:       <pages unit='KiB' size='2048'/>
Nov 14 02:01:52 user nova-compute[75257]:     </cpu>
Nov 14 02:01:52 user nova-compute[75257]:     <power_management>
Nov 14 02:01:52 user nova-compute[75257]:       <suspend_mem/>
Nov 14 02:01:52 user nova-compute[75257]:       <suspend_disk/>
Nov 14 02:01:52 user nova-compute[75257]:       <suspend_hybrid/>
Nov 14 02:01:52 user nova-compute[75257]:     </power_management>
Nov 14 02:01:52 user nova-compute[75257]:     <iommu support='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     <migration_features>
Nov 14 02:01:52 user nova-compute[75257]:       <live/>
Nov 14 02:01:52 user nova-compute[75257]:       <uri_transports>
Nov 14 02:01:52 user nova-compute[75257]:         <uri_transport>tcp</uri_transport>
Nov 14 02:01:52 user nova-compute[75257]:         <uri_transport>rdma</uri_transport>
Nov 14 02:01:52 user nova-compute[75257]:       </uri_transports>
Nov 14 02:01:52 user nova-compute[75257]:     </migration_features>
Nov 14 02:01:52 user nova-compute[75257]:     <topology>
Nov 14 02:01:52 user nova-compute[75257]:       <cells num='2'>
Nov 14 02:01:52 user nova-compute[75257]:         <cell id='0'>
Nov 14 02:01:52 user nova-compute[75257]:           <memory unit='KiB'>8140616</memory>
Nov 14 02:01:52 user nova-compute[75257]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 14 02:01:52 user nova-compute[75257]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 02:01:52 user nova-compute[75257]:           <distances>
Nov 14 02:01:52 user nova-compute[75257]:             <sibling id='0' value='10'/>
Nov 14 02:01:52 user nova-compute[75257]:             <sibling id='1' value='20'/>
Nov 14 02:01:52 user nova-compute[75257]:           </distances>
Nov 14 02:01:52 user nova-compute[75257]:           <cpus num='6'>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 02:01:52 user nova-compute[75257]:           </cpus>
Nov 14 02:01:52 user nova-compute[75257]:         </cell>
Nov 14 02:01:52 user nova-compute[75257]:         <cell id='1'>
Nov 14 02:01:52 user nova-compute[75257]:           <memory unit='KiB'>8255100</memory>
Nov 14 02:01:52 user nova-compute[75257]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 14 02:01:52 user nova-compute[75257]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 02:01:52 user nova-compute[75257]:           <distances>
Nov 14 02:01:52 user nova-compute[75257]:             <sibling id='0' value='20'/>
Nov 14 02:01:52 user nova-compute[75257]:             <sibling id='1' value='10'/>
Nov 14 02:01:52 user nova-compute[75257]:           </distances>
Nov 14 02:01:52 user nova-compute[75257]:           <cpus num='6'>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 02:01:52 user nova-compute[75257]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 02:01:52 user nova-compute[75257]:           </cpus>
Nov 14 02:01:52 user nova-compute[75257]:         </cell>
Nov 14 02:01:52 user nova-compute[75257]:       </cells>
Nov 14 02:01:52 user nova-compute[75257]:     </topology>
Nov 14 02:01:52 user nova-compute[75257]:     <cache>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 02:01:52 user nova-compute[75257]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 02:01:52 user nova-compute[75257]:     </cache>
Nov 14 02:01:52 user nova-compute[75257]:     <secmodel>
Nov 14 02:01:52 user nova-compute[75257]:       <model>apparmor</model>
Nov 14 02:01:52 user nova-compute[75257]:       <doi>0</doi>
Nov 14 02:01:52 user nova-compute[75257]:     </secmodel>
Nov 14 02:01:52 user nova-compute[75257]:     <secmodel>
Nov 14 02:01:52 user nova-compute[75257]:       <model>dac</model>
Nov 14 02:01:52 user nova-compute[75257]:       <doi>0</doi>
Nov 14 02:01:52 user nova-compute[75257]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 02:01:52 user nova-compute[75257]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 02:01:52 user nova-compute[75257]:     </secmodel>
Nov 14 02:01:52 user nova-compute[75257]:   </host>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='alpha'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>clipper</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='armv6l'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>spitz</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>nuri</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>kzm</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sx1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>z2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>tosa</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>n810</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>n800</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>terrier</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>midway</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>microbit</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>verdex</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>highbank</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>akita</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>connex</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>collie</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='armv7l'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>spitz</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>nuri</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>kzm</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sx1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>z2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>tosa</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>n810</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>n800</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>terrier</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>midway</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>microbit</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>verdex</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>highbank</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>akita</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>connex</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>collie</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='aarch64'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>spitz</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>nuri</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>kzm</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sx1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>z2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>tosa</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>n810</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>n800</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>terrier</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>midway</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>microbit</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>verdex</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>highbank</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>akita</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>connex</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>collie</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <acpi default='on' toggle='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='cris'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='i686'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>isapc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>microvm</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='kvm'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <pae/>
Nov 14 02:01:52 user nova-compute[75257]:       <nonpae/>
Nov 14 02:01:52 user nova-compute[75257]:       <acpi default='on' toggle='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:       <apic default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='m68k'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>an5206</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>q800</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='microblaze'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='microblazeel'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='mips'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='16'>malta</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='mipsel'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='16'>malta</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='mips64'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='16'>malta</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>pica61</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>magnum</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='mips64el'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='16'>malta</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>pica61</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>magnum</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='16'>boston</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='ppc'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mac99</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>40p</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>taihu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='ppc64'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>taihu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>40p</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mac99</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='ppc64le'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>taihu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>40p</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>mac99</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='riscv32'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='8'>spike</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='8'>virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='riscv64'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='8'>spike</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='8'>virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='s390x'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='sh4'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>shix</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>r2d</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='sh4eb'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>shix</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>r2d</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='sparc'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>LX</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='sparc64'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>niagara</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='x86_64'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>64</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='1'>isapc</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>microvm</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='kvm'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <acpi default='on' toggle='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:       <apic default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='xtensa'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>sim</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>kc705</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>ml605</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>lx200</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>lx60</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]:   <guest>
Nov 14 02:01:52 user nova-compute[75257]:     <os_type>hvm</os_type>
Nov 14 02:01:52 user nova-compute[75257]:     <arch name='xtensaeb'>
Nov 14 02:01:52 user nova-compute[75257]:       <wordsize>32</wordsize>
Nov 14 02:01:52 user nova-compute[75257]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='4'>sim</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>kc705</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>ml605</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>virt</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>lx200</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>lx60</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 02:01:52 user nova-compute[75257]:       <domain type='qemu'/>
Nov 14 02:01:52 user nova-compute[75257]:     </arch>
Nov 14 02:01:52 user nova-compute[75257]:     <features>
Nov 14 02:01:52 user nova-compute[75257]:       <cpuselection/>
Nov 14 02:01:52 user nova-compute[75257]:       <deviceboot/>
Nov 14 02:01:52 user nova-compute[75257]:       <disksnapshot default='on' toggle='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     </features>
Nov 14 02:01:52 user nova-compute[75257]:   </guest>
Nov 14 02:01:52 user nova-compute[75257]: </capabilities>
Nov 14 02:01:52 user nova-compute[75257]: 
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 02:01:52 user nova-compute[75257]: <domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 02:01:52 user nova-compute[75257]:   <domain>kvm</domain>
Nov 14 02:01:52 user nova-compute[75257]:   <machine>pc-q35-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:   <arch>i686</arch>
Nov 14 02:01:52 user nova-compute[75257]:   <vcpu max='288'/>
Nov 14 02:01:52 user nova-compute[75257]:   <iothreads supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:   <os supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='firmware'/>
Nov 14 02:01:52 user nova-compute[75257]:     <loader supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>rom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pflash</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='readonly'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='secure'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </loader>
Nov 14 02:01:52 user nova-compute[75257]:   </os>
Nov 14 02:01:52 user nova-compute[75257]:   <cpu>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-passthrough' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='hostPassthroughMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='maximum' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='maximumMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-model' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <vendor>Intel</vendor>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ss'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='vmx'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pcid'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='hypervisor'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arat'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='umip'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='md-clear'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibpb'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibrs'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='erms'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='lm'/>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='custom' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>qemu64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>qemu32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>phenom</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>n270</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>kvm64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>coreduo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>core2duo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>athlon</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Westmere</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Snowridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Penryn</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G5</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G4</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G1</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Nehalem</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Rome</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Milan</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Dhyana</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cooperlake</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Conroe</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>486</model>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:   </cpu>
Nov 14 02:01:52 user nova-compute[75257]:   <memoryBacking supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='sourceType'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>file</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>anonymous</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>memfd</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:   </memoryBacking>
Nov 14 02:01:52 user nova-compute[75257]:   <devices>
Nov 14 02:01:52 user nova-compute[75257]:     <disk supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='diskDevice'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>disk</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cdrom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>floppy</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>lun</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='bus'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>fdc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sata</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </disk>
Nov 14 02:01:52 user nova-compute[75257]:     <graphics supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sdl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vnc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>spice</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egl-headless</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </graphics>
Nov 14 02:01:52 user nova-compute[75257]:     <video supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='modelType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cirrus</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vmvga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>qxl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>none</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>bochs</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ramfb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </video>
Nov 14 02:01:52 user nova-compute[75257]:     <hostdev supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='mode'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>subsystem</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='startupPolicy'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>default</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>mandatory</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>requisite</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>optional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='subsysType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pci</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='capsType'/>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='pciBackend'/>
Nov 14 02:01:52 user nova-compute[75257]:     </hostdev>
Nov 14 02:01:52 user nova-compute[75257]:     <rng supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>random</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egd</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>builtin</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </rng>
Nov 14 02:01:52 user nova-compute[75257]:     <filesystem supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='driverType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>path</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>handle</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtiofs</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </filesystem>
Nov 14 02:01:52 user nova-compute[75257]:     <tpm supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-tis</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-crb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>passthrough</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>emulator</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </tpm>
Nov 14 02:01:52 user nova-compute[75257]:   </devices>
Nov 14 02:01:52 user nova-compute[75257]:   <features>
Nov 14 02:01:52 user nova-compute[75257]:     <gic supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     <vmcoreinfo supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <genid supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backingStoreInput supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backup supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <sev supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:   </features>
Nov 14 02:01:52 user nova-compute[75257]: </domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:  {{(pid=75257) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 02:01:52 user nova-compute[75257]: <domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 02:01:52 user nova-compute[75257]:   <domain>kvm</domain>
Nov 14 02:01:52 user nova-compute[75257]:   <machine>pc-i440fx-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:   <arch>i686</arch>
Nov 14 02:01:52 user nova-compute[75257]:   <vcpu max='255'/>
Nov 14 02:01:52 user nova-compute[75257]:   <iothreads supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:   <os supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='firmware'/>
Nov 14 02:01:52 user nova-compute[75257]:     <loader supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>rom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pflash</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='readonly'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='secure'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </loader>
Nov 14 02:01:52 user nova-compute[75257]:   </os>
Nov 14 02:01:52 user nova-compute[75257]:   <cpu>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-passthrough' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='hostPassthroughMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='maximum' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='maximumMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-model' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <vendor>Intel</vendor>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ss'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='vmx'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pcid'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='hypervisor'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arat'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='umip'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='md-clear'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibpb'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibrs'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='erms'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='lm'/>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='custom' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>qemu64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>qemu32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>phenom</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>n270</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>kvm64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>coreduo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>core2duo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>athlon</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Westmere</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Snowridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Penryn</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G5</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G4</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G1</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Nehalem</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Rome</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Milan</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Dhyana</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cooperlake</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Conroe</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>486</model>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:   </cpu>
Nov 14 02:01:52 user nova-compute[75257]:   <memoryBacking supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='sourceType'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>file</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>anonymous</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>memfd</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:   </memoryBacking>
Nov 14 02:01:52 user nova-compute[75257]:   <devices>
Nov 14 02:01:52 user nova-compute[75257]:     <disk supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='diskDevice'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>disk</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cdrom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>floppy</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>lun</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='bus'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ide</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>fdc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sata</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </disk>
Nov 14 02:01:52 user nova-compute[75257]:     <graphics supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sdl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vnc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>spice</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egl-headless</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </graphics>
Nov 14 02:01:52 user nova-compute[75257]:     <video supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='modelType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cirrus</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vmvga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>qxl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>none</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>bochs</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ramfb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </video>
Nov 14 02:01:52 user nova-compute[75257]:     <hostdev supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='mode'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>subsystem</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='startupPolicy'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>default</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>mandatory</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>requisite</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>optional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='subsysType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pci</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='capsType'/>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='pciBackend'/>
Nov 14 02:01:52 user nova-compute[75257]:     </hostdev>
Nov 14 02:01:52 user nova-compute[75257]:     <rng supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>random</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egd</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>builtin</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </rng>
Nov 14 02:01:52 user nova-compute[75257]:     <filesystem supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='driverType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>path</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>handle</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtiofs</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </filesystem>
Nov 14 02:01:52 user nova-compute[75257]:     <tpm supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-tis</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-crb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>passthrough</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>emulator</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </tpm>
Nov 14 02:01:52 user nova-compute[75257]:   </devices>
Nov 14 02:01:52 user nova-compute[75257]:   <features>
Nov 14 02:01:52 user nova-compute[75257]:     <gic supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     <vmcoreinfo supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <genid supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backingStoreInput supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backup supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <sev supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:   </features>
Nov 14 02:01:52 user nova-compute[75257]: </domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:  {{(pid=75257) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 02:01:52 user nova-compute[75257]: <domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 02:01:52 user nova-compute[75257]:   <domain>kvm</domain>
Nov 14 02:01:52 user nova-compute[75257]:   <machine>pc-i440fx-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:   <arch>i686</arch>
Nov 14 02:01:52 user nova-compute[75257]:   <vcpu max='255'/>
Nov 14 02:01:52 user nova-compute[75257]:   <iothreads supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:   <os supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='firmware'/>
Nov 14 02:01:52 user nova-compute[75257]:     <loader supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>rom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pflash</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='readonly'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='secure'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </loader>
Nov 14 02:01:52 user nova-compute[75257]:   </os>
Nov 14 02:01:52 user nova-compute[75257]:   <cpu>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-passthrough' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='hostPassthroughMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='maximum' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='maximumMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-model' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <vendor>Intel</vendor>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ss'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='vmx'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pcid'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='hypervisor'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arat'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='umip'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='md-clear'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibpb'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibrs'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='erms'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='lm'/>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='custom' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>qemu64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>qemu32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>phenom</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>n270</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>kvm64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>coreduo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>core2duo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>athlon</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Westmere</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Snowridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Penryn</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G5</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G4</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G1</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Nehalem</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Rome</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Milan</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Dhyana</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cooperlake</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Conroe</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>486</model>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:   </cpu>
Nov 14 02:01:52 user nova-compute[75257]:   <memoryBacking supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='sourceType'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>file</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>anonymous</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>memfd</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:   </memoryBacking>
Nov 14 02:01:52 user nova-compute[75257]:   <devices>
Nov 14 02:01:52 user nova-compute[75257]:     <disk supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='diskDevice'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>disk</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cdrom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>floppy</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>lun</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='bus'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ide</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>fdc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sata</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </disk>
Nov 14 02:01:52 user nova-compute[75257]:     <graphics supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sdl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vnc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>spice</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egl-headless</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </graphics>
Nov 14 02:01:52 user nova-compute[75257]:     <video supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='modelType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cirrus</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vmvga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>qxl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>none</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>bochs</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ramfb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </video>
Nov 14 02:01:52 user nova-compute[75257]:     <hostdev supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='mode'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>subsystem</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='startupPolicy'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>default</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>mandatory</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>requisite</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>optional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='subsysType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pci</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='capsType'/>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='pciBackend'/>
Nov 14 02:01:52 user nova-compute[75257]:     </hostdev>
Nov 14 02:01:52 user nova-compute[75257]:     <rng supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>random</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egd</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>builtin</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </rng>
Nov 14 02:01:52 user nova-compute[75257]:     <filesystem supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='driverType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>path</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>handle</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtiofs</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </filesystem>
Nov 14 02:01:52 user nova-compute[75257]:     <tpm supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-tis</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-crb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>passthrough</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>emulator</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </tpm>
Nov 14 02:01:52 user nova-compute[75257]:   </devices>
Nov 14 02:01:52 user nova-compute[75257]:   <features>
Nov 14 02:01:52 user nova-compute[75257]:     <gic supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     <vmcoreinfo supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <genid supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backingStoreInput supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backup supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <sev supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:   </features>
Nov 14 02:01:52 user nova-compute[75257]: </domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:  {{(pid=75257) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 02:01:52 user nova-compute[75257]: <domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 02:01:52 user nova-compute[75257]:   <domain>kvm</domain>
Nov 14 02:01:52 user nova-compute[75257]:   <machine>pc-q35-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:   <arch>i686</arch>
Nov 14 02:01:52 user nova-compute[75257]:   <vcpu max='288'/>
Nov 14 02:01:52 user nova-compute[75257]:   <iothreads supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:   <os supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='firmware'/>
Nov 14 02:01:52 user nova-compute[75257]:     <loader supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>rom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pflash</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='readonly'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='secure'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </loader>
Nov 14 02:01:52 user nova-compute[75257]:   </os>
Nov 14 02:01:52 user nova-compute[75257]:   <cpu>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-passthrough' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='hostPassthroughMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='maximum' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='maximumMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-model' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <vendor>Intel</vendor>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ss'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='vmx'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pcid'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='hypervisor'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arat'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='umip'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='md-clear'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibpb'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibrs'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='erms'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='lm'/>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='custom' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>qemu64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>qemu32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>phenom</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>n270</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>kvm64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>coreduo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>core2duo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>athlon</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Westmere</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Snowridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Penryn</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G5</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G4</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G1</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Nehalem</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Rome</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Milan</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Dhyana</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cooperlake</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Conroe</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>486</model>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:   </cpu>
Nov 14 02:01:52 user nova-compute[75257]:   <memoryBacking supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='sourceType'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>file</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>anonymous</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>memfd</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:   </memoryBacking>
Nov 14 02:01:52 user nova-compute[75257]:   <devices>
Nov 14 02:01:52 user nova-compute[75257]:     <disk supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='diskDevice'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>disk</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cdrom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>floppy</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>lun</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='bus'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>fdc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sata</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </disk>
Nov 14 02:01:52 user nova-compute[75257]:     <graphics supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sdl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vnc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>spice</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egl-headless</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </graphics>
Nov 14 02:01:52 user nova-compute[75257]:     <video supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='modelType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cirrus</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vmvga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>qxl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>none</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>bochs</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ramfb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </video>
Nov 14 02:01:52 user nova-compute[75257]:     <hostdev supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='mode'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>subsystem</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='startupPolicy'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>default</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>mandatory</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>requisite</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>optional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='subsysType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pci</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='capsType'/>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='pciBackend'/>
Nov 14 02:01:52 user nova-compute[75257]:     </hostdev>
Nov 14 02:01:52 user nova-compute[75257]:     <rng supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>random</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egd</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>builtin</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </rng>
Nov 14 02:01:52 user nova-compute[75257]:     <filesystem supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='driverType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>path</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>handle</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtiofs</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </filesystem>
Nov 14 02:01:52 user nova-compute[75257]:     <tpm supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-tis</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-crb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>passthrough</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>emulator</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </tpm>
Nov 14 02:01:52 user nova-compute[75257]:   </devices>
Nov 14 02:01:52 user nova-compute[75257]:   <features>
Nov 14 02:01:52 user nova-compute[75257]:     <gic supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     <vmcoreinfo supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <genid supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backingStoreInput supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backup supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <sev supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:   </features>
Nov 14 02:01:52 user nova-compute[75257]: </domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:  {{(pid=75257) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 02:01:52 user nova-compute[75257]: <domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 02:01:52 user nova-compute[75257]:   <domain>kvm</domain>
Nov 14 02:01:52 user nova-compute[75257]:   <machine>pc-q35-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:   <arch>x86_64</arch>
Nov 14 02:01:52 user nova-compute[75257]:   <vcpu max='288'/>
Nov 14 02:01:52 user nova-compute[75257]:   <iothreads supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:   <os supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='firmware'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>efi</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:     <loader supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>rom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pflash</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='readonly'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='secure'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </loader>
Nov 14 02:01:52 user nova-compute[75257]:   </os>
Nov 14 02:01:52 user nova-compute[75257]:   <cpu>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-passthrough' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='hostPassthroughMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='maximum' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='maximumMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-model' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <vendor>Intel</vendor>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ss'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='vmx'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pcid'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='hypervisor'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arat'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='umip'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='md-clear'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='invtsc'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibpb'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibrs'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='rsba'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='erms'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='custom' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>qemu64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>qemu32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>phenom</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>n270</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>coreduo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>core2duo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>athlon</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Westmere</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Snowridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Penryn</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G5</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G4</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Opteron_G1</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Nehalem</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Rome</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Milan</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Dhyana</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cooperlake</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Conroe</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>486</model>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:   </cpu>
Nov 14 02:01:52 user nova-compute[75257]:   <memoryBacking supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='sourceType'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>file</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>anonymous</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>memfd</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:   </memoryBacking>
Nov 14 02:01:52 user nova-compute[75257]:   <devices>
Nov 14 02:01:52 user nova-compute[75257]:     <disk supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='diskDevice'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>disk</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cdrom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>floppy</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>lun</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='bus'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>fdc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sata</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </disk>
Nov 14 02:01:52 user nova-compute[75257]:     <graphics supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sdl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vnc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>spice</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egl-headless</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </graphics>
Nov 14 02:01:52 user nova-compute[75257]:     <video supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='modelType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cirrus</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vmvga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>qxl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>none</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>bochs</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ramfb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </video>
Nov 14 02:01:52 user nova-compute[75257]:     <hostdev supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='mode'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>subsystem</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='startupPolicy'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>default</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>mandatory</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>requisite</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>optional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='subsysType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pci</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='capsType'/>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='pciBackend'/>
Nov 14 02:01:52 user nova-compute[75257]:     </hostdev>
Nov 14 02:01:52 user nova-compute[75257]:     <rng supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>random</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egd</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>builtin</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </rng>
Nov 14 02:01:52 user nova-compute[75257]:     <filesystem supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='driverType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>path</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>handle</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtiofs</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </filesystem>
Nov 14 02:01:52 user nova-compute[75257]:     <tpm supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-tis</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-crb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>passthrough</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>emulator</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </tpm>
Nov 14 02:01:52 user nova-compute[75257]:   </devices>
Nov 14 02:01:52 user nova-compute[75257]:   <features>
Nov 14 02:01:52 user nova-compute[75257]:     <gic supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     <vmcoreinfo supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <genid supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backingStoreInput supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backup supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <sev supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:   </features>
Nov 14 02:01:52 user nova-compute[75257]: </domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:  {{(pid=75257) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 02:01:52 user nova-compute[75257]: <domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 02:01:52 user nova-compute[75257]:   <domain>kvm</domain>
Nov 14 02:01:52 user nova-compute[75257]:   <machine>pc-i440fx-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:   <arch>x86_64</arch>
Nov 14 02:01:52 user nova-compute[75257]:   <vcpu max='255'/>
Nov 14 02:01:52 user nova-compute[75257]:   <iothreads supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:   <os supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='firmware'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>efi</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:     <loader supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>rom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pflash</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='readonly'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='secure'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </loader>
Nov 14 02:01:52 user nova-compute[75257]:   </os>
Nov 14 02:01:52 user nova-compute[75257]:   <cpu>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-passthrough' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='hostPassthroughMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='maximum' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='maximumMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-model' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <vendor>Intel</vendor>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ss'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='vmx'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pcid'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='hypervisor'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arat'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='umip'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='md-clear'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='invtsc'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibpb'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibrs'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='rsba'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='erms'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='custom' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>qemu64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>qemu32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>phenom</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>n270</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>coreduo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>core2duo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>athlon</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Westmere</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Snowridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Penryn</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G5</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G4</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Opteron_G1</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Nehalem</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Rome</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Milan</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Dhyana</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cooperlake</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Conroe</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>486</model>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:   </cpu>
Nov 14 02:01:52 user nova-compute[75257]:   <memoryBacking supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='sourceType'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>file</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>anonymous</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>memfd</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:   </memoryBacking>
Nov 14 02:01:52 user nova-compute[75257]:   <devices>
Nov 14 02:01:52 user nova-compute[75257]:     <disk supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='diskDevice'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>disk</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cdrom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>floppy</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>lun</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='bus'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ide</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>fdc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sata</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </disk>
Nov 14 02:01:52 user nova-compute[75257]:     <graphics supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sdl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vnc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>spice</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egl-headless</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </graphics>
Nov 14 02:01:52 user nova-compute[75257]:     <video supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='modelType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cirrus</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vmvga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>qxl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>none</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>bochs</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ramfb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </video>
Nov 14 02:01:52 user nova-compute[75257]:     <hostdev supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='mode'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>subsystem</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='startupPolicy'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>default</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>mandatory</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>requisite</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>optional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='subsysType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pci</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='capsType'/>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='pciBackend'/>
Nov 14 02:01:52 user nova-compute[75257]:     </hostdev>
Nov 14 02:01:52 user nova-compute[75257]:     <rng supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>random</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egd</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>builtin</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </rng>
Nov 14 02:01:52 user nova-compute[75257]:     <filesystem supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='driverType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>path</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>handle</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtiofs</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </filesystem>
Nov 14 02:01:52 user nova-compute[75257]:     <tpm supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-tis</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-crb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>passthrough</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>emulator</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </tpm>
Nov 14 02:01:52 user nova-compute[75257]:   </devices>
Nov 14 02:01:52 user nova-compute[75257]:   <features>
Nov 14 02:01:52 user nova-compute[75257]:     <gic supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     <vmcoreinfo supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <genid supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backingStoreInput supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backup supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <sev supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:   </features>
Nov 14 02:01:52 user nova-compute[75257]: </domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:  {{(pid=75257) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 02:01:52 user nova-compute[75257]: <domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 02:01:52 user nova-compute[75257]:   <domain>kvm</domain>
Nov 14 02:01:52 user nova-compute[75257]:   <machine>pc-i440fx-6.2</machine>
Nov 14 02:01:52 user nova-compute[75257]:   <arch>x86_64</arch>
Nov 14 02:01:52 user nova-compute[75257]:   <vcpu max='255'/>
Nov 14 02:01:52 user nova-compute[75257]:   <iothreads supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:   <os supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='firmware'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>efi</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:     <loader supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>rom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pflash</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='readonly'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='secure'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </loader>
Nov 14 02:01:52 user nova-compute[75257]:   </os>
Nov 14 02:01:52 user nova-compute[75257]:   <cpu>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-passthrough' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='hostPassthroughMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='maximum' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='maximumMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-model' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <vendor>Intel</vendor>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ss'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='vmx'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pcid'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='hypervisor'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arat'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='umip'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='md-clear'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='invtsc'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibpb'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibrs'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='rsba'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='erms'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='custom' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>qemu64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>qemu32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>phenom</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>n270</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>coreduo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>core2duo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>athlon</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Westmere</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Snowridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Penryn</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G5</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G4</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Opteron_G1</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Nehalem</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Rome</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Milan</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Dhyana</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cooperlake</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Conroe</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>486</model>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:   </cpu>
Nov 14 02:01:52 user nova-compute[75257]:   <memoryBacking supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='sourceType'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>file</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>anonymous</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>memfd</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:   </memoryBacking>
Nov 14 02:01:52 user nova-compute[75257]:   <devices>
Nov 14 02:01:52 user nova-compute[75257]:     <disk supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='diskDevice'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>disk</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cdrom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>floppy</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>lun</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='bus'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ide</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>fdc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sata</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </disk>
Nov 14 02:01:52 user nova-compute[75257]:     <graphics supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sdl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vnc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>spice</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egl-headless</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </graphics>
Nov 14 02:01:52 user nova-compute[75257]:     <video supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='modelType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cirrus</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vmvga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>qxl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>none</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>bochs</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ramfb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </video>
Nov 14 02:01:52 user nova-compute[75257]:     <hostdev supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='mode'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>subsystem</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='startupPolicy'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>default</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>mandatory</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>requisite</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>optional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='subsysType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pci</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='capsType'/>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='pciBackend'/>
Nov 14 02:01:52 user nova-compute[75257]:     </hostdev>
Nov 14 02:01:52 user nova-compute[75257]:     <rng supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>random</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egd</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>builtin</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </rng>
Nov 14 02:01:52 user nova-compute[75257]:     <filesystem supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='driverType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>path</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>handle</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtiofs</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </filesystem>
Nov 14 02:01:52 user nova-compute[75257]:     <tpm supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-tis</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-crb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>passthrough</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>emulator</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </tpm>
Nov 14 02:01:52 user nova-compute[75257]:   </devices>
Nov 14 02:01:52 user nova-compute[75257]:   <features>
Nov 14 02:01:52 user nova-compute[75257]:     <gic supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     <vmcoreinfo supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <genid supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backingStoreInput supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backup supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <sev supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:   </features>
Nov 14 02:01:52 user nova-compute[75257]: </domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:  {{(pid=75257) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 02:01:52 user nova-compute[75257]: <domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 02:01:52 user nova-compute[75257]:   <domain>kvm</domain>
Nov 14 02:01:52 user nova-compute[75257]:   <machine>pc-q35-jammy</machine>
Nov 14 02:01:52 user nova-compute[75257]:   <arch>x86_64</arch>
Nov 14 02:01:52 user nova-compute[75257]:   <vcpu max='288'/>
Nov 14 02:01:52 user nova-compute[75257]:   <iothreads supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:   <os supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='firmware'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>efi</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:     <loader supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>rom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pflash</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='readonly'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='secure'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>yes</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>no</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </loader>
Nov 14 02:01:52 user nova-compute[75257]:   </os>
Nov 14 02:01:52 user nova-compute[75257]:   <cpu>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-passthrough' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='hostPassthroughMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='maximum' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='maximumMigratable'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>on</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>off</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='host-model' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <vendor>Intel</vendor>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ss'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='vmx'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pcid'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='hypervisor'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arat'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='umip'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='md-clear'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='invtsc'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibpb'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='ibrs'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-stibp'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='rsba'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='erms'/>
Nov 14 02:01:52 user nova-compute[75257]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:     <mode name='custom' supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>qemu64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>qemu32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>phenom</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>pentium</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>n270</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm64</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>kvm32</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>coreduo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>core2duo</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>athlon</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Westmere</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Snowridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Skylake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>SandyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Penryn</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G5</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G4</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G3</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Opteron_G2</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Opteron_G1</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Nehalem</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>IvyBridge</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Icelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Haswell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Rome</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-Milan</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>EPYC</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Dhyana</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cooperlake</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>Conroe</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='no'>Broadwell</model>
Nov 14 02:01:52 user nova-compute[75257]:       <model usable='yes'>486</model>
Nov 14 02:01:52 user nova-compute[75257]:     </mode>
Nov 14 02:01:52 user nova-compute[75257]:   </cpu>
Nov 14 02:01:52 user nova-compute[75257]:   <memoryBacking supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:     <enum name='sourceType'>
Nov 14 02:01:52 user nova-compute[75257]:       <value>file</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>anonymous</value>
Nov 14 02:01:52 user nova-compute[75257]:       <value>memfd</value>
Nov 14 02:01:52 user nova-compute[75257]:     </enum>
Nov 14 02:01:52 user nova-compute[75257]:   </memoryBacking>
Nov 14 02:01:52 user nova-compute[75257]:   <devices>
Nov 14 02:01:52 user nova-compute[75257]:     <disk supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='diskDevice'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>disk</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cdrom</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>floppy</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>lun</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='bus'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>fdc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sata</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </disk>
Nov 14 02:01:52 user nova-compute[75257]:     <graphics supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='type'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>sdl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vnc</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>spice</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egl-headless</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </graphics>
Nov 14 02:01:52 user nova-compute[75257]:     <video supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='modelType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>cirrus</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>vmvga</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>qxl</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>none</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>bochs</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>ramfb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </video>
Nov 14 02:01:52 user nova-compute[75257]:     <hostdev supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='mode'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>subsystem</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='startupPolicy'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>default</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>mandatory</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>requisite</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>optional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='subsysType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>usb</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>pci</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>scsi</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='capsType'/>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='pciBackend'/>
Nov 14 02:01:52 user nova-compute[75257]:     </hostdev>
Nov 14 02:01:52 user nova-compute[75257]:     <rng supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtio-non-transitional</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>random</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>egd</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>builtin</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </rng>
Nov 14 02:01:52 user nova-compute[75257]:     <filesystem supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='driverType'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>path</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>handle</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>virtiofs</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </filesystem>
Nov 14 02:01:52 user nova-compute[75257]:     <tpm supported='yes'>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='model'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-tis</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>tpm-crb</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:       <enum name='backendModel'>
Nov 14 02:01:52 user nova-compute[75257]:         <value>passthrough</value>
Nov 14 02:01:52 user nova-compute[75257]:         <value>emulator</value>
Nov 14 02:01:52 user nova-compute[75257]:       </enum>
Nov 14 02:01:52 user nova-compute[75257]:     </tpm>
Nov 14 02:01:52 user nova-compute[75257]:   </devices>
Nov 14 02:01:52 user nova-compute[75257]:   <features>
Nov 14 02:01:52 user nova-compute[75257]:     <gic supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:     <vmcoreinfo supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <genid supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backingStoreInput supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <backup supported='yes'/>
Nov 14 02:01:52 user nova-compute[75257]:     <sev supported='no'/>
Nov 14 02:01:52 user nova-compute[75257]:   </features>
Nov 14 02:01:52 user nova-compute[75257]: </domainCapabilities>
Nov 14 02:01:52 user nova-compute[75257]:  {{(pid=75257) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75257) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75257) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Checking secure boot support for host arch (x86_64) {{(pid=75257) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 02:01:52 user nova-compute[75257]: INFO nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Secure Boot support detected
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] cpu compare xml: <cpu match="exact">
Nov 14 02:01:52 user nova-compute[75257]:   <model>Nehalem</model>
Nov 14 02:01:52 user nova-compute[75257]: </cpu>
Nov 14 02:01:52 user nova-compute[75257]:  {{(pid=75257) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 02:01:52 user nova-compute[75257]: INFO nova.virt.node [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Generated node identity d089fce4-28ce-4f05-848e-0c103c9d96c6
Nov 14 02:01:52 user nova-compute[75257]: INFO nova.virt.node [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Wrote node identity d089fce4-28ce-4f05-848e-0c103c9d96c6 to /opt/stack/data/nova/compute_id
Nov 14 02:01:52 user nova-compute[75257]: WARNING nova.compute.manager [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Compute nodes ['d089fce4-28ce-4f05-848e-0c103c9d96c6'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 02:01:52 user nova-compute[75257]: INFO nova.compute.manager [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 02:01:52 user nova-compute[75257]: WARNING nova.compute.manager [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 02:01:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:01:52 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:01:53 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:01:53 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Hypervisor/Node resource view: name=user free_ram=10953MB free_disk=26.328067779541016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:01:53 user nova-compute[75257]: WARNING nova.compute.resource_tracker [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] No compute node record for user:d089fce4-28ce-4f05-848e-0c103c9d96c6: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d089fce4-28ce-4f05-848e-0c103c9d96c6 could not be found.
Nov 14 02:01:53 user nova-compute[75257]: INFO nova.compute.resource_tracker [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Compute node record created for user:user with uuid: d089fce4-28ce-4f05-848e-0c103c9d96c6
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:01:53 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] [req-352ec428-8d03-4dc7-8864-55135c7ef025] Created resource provider record via placement API for resource provider with UUID d089fce4-28ce-4f05-848e-0c103c9d96c6 and name user.
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75257) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 02:01:53 user nova-compute[75257]: INFO nova.virt.libvirt.host [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] kernel doesn't support AMD SEV
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Libvirt baseline CPU <cpu>
Nov 14 02:01:53 user nova-compute[75257]:   <arch>x86_64</arch>
Nov 14 02:01:53 user nova-compute[75257]:   <model>Nehalem</model>
Nov 14 02:01:53 user nova-compute[75257]:   <vendor>Intel</vendor>
Nov 14 02:01:53 user nova-compute[75257]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 02:01:53 user nova-compute[75257]: </cpu>
Nov 14 02:01:53 user nova-compute[75257]:  {{(pid=75257) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Updated inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Updating resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 generation from 0 to 1 during operation: update_inventory {{(pid=75257) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Updating resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 generation from 1 to 2 during operation: update_traits {{(pid=75257) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.694s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.service [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Creating RPC server for service compute {{(pid=75257) start /opt/stack/nova/nova/service.py:182}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.service [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] Join ServiceGroup membership for this service compute {{(pid=75257) start /opt/stack/nova/nova/service.py:199}}
Nov 14 02:01:53 user nova-compute[75257]: DEBUG nova.servicegroup.drivers.db [None req-54b58be3-0be8-4213-a130-51c141f655f3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75257) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 02:02:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:02:44 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:02:44 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:02:44 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=10431MB free_disk=26.100990295410156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:02:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:02:45 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:02:45 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:02:45 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:02:45 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:02:45 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:02:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:03:45 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:03:45 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=10360MB free_disk=26.165374755859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:03:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:03:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:03:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:03:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:04:46 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:04:46 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:04:46 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=10386MB free_disk=25.917835235595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:04:46 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:04:47 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:04:47 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:04:47 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:04:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:05:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:47 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:47 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:05:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:05:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:05:47 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:48 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:48 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:05:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:48 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:05:48 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:05:48 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:05:48 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9614MB free_disk=25.93740463256836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:05:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:49 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:05:49 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:05:49 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:05:49 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:05:49 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:05:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "2f9df98c-7814-419d-8821-d8c571972f0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "2f9df98c-7814-419d-8821-d8c571972f0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:05:55 user nova-compute[75257]: INFO nova.compute.claims [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Claim successful on node user
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.330s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:05:56 user nova-compute[75257]: INFO nova.compute.claims [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Claim successful on node user
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:05:56 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:05:56 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Creating image(s)
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "/opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "/opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "/opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.641s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:05:56 user nova-compute[75257]: INFO nova.compute.claims [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Claim successful on node user
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.network.neutron [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:05:56 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.policy [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ca1c02f69824ccabfbf9ada3f202403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fe3e87f6d484f8f205662dcc31a4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.policy [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:05:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Creating image(s)
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "/opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "/opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "/opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66.part --force-share --output=json" returned: 0 in 0.168s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.virt.images [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] ccff493f-43f6-4683-9bdc-984e861f9bf9 was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66.part /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.945s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.321s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:05:57 user nova-compute[75257]: INFO nova.compute.claims [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Claim successful on node user
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66.part /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66.converted" returned: 0 in 0.353s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.network.neutron [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:05:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.264s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:57 user nova-compute[75257]: INFO oslo.privsep.daemon [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphm2g205i/privsep.sock']
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.651s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:57 user sudo[84552]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphm2g205i/privsep.sock
Nov 14 02:05:57 user sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:05:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Creating image(s)
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "/opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "/opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.636s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:05:58 user nova-compute[75257]: INFO nova.compute.claims [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Claim successful on node user
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.policy [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:05:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:05:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Creating image(s)
Nov 14 02:05:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.policy [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '684b5b76244349489205840fb9b4e39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c82a8c1198544448e57221af68aa01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:05:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:05:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Creating image(s)
Nov 14 02:05:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "/opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "/opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:58 user nova-compute[75257]: DEBUG nova.policy [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Successfully created port: 57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:05:59 user sudo[84552]: pam_unix(sudo:session): session closed for user root
Nov 14 02:05:59 user nova-compute[75257]: INFO oslo.privsep.daemon [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Spawned new privsep daemon via rootwrap
Nov 14 02:05:59 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 02:05:59 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 02:05:59 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 02:05:59 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84555
Nov 14 02:05:59 user nova-compute[75257]: WARNING oslo_privsep.priv_context [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] privsep daemon already running
Nov 14 02:05:59 user nova-compute[75257]: WARNING oslo_privsep.priv_context [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] privsep daemon already running
Nov 14 02:05:59 user nova-compute[75257]: WARNING oslo_privsep.priv_context [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] privsep daemon already running
Nov 14 02:05:59 user nova-compute[75257]: WARNING oslo_privsep.priv_context [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] privsep daemon already running
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Successfully created port: cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.199s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.204s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Successfully created port: 592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk 1073741824" returned: 0 in 0.044s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.253s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:05:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.223s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.230s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk 1073741824" returned: 0 in 0.043s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.535s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Cannot resize image /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Ensure instance console log exists: /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk 1073741824" returned: 0 in 0.049s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Successfully created port: 8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.836s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Cannot resize image /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Ensure instance console log exists: /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk 1073741824" returned: 0 in 0.044s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 1.052s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Cannot resize image /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Ensure instance console log exists: /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Successfully created port: 305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.163s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:06:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.203s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk 1073741824" returned: 0 in 0.069s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Cannot resize image /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Ensure instance console log exists: /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Cannot resize image /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Ensure instance console log exists: /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Successfully updated port: cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquired lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Successfully updated port: 57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "refresh_cache-8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquired lock "refresh_cache-8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-changed-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Refreshing instance network info cache due to event network-changed-cc019053-7c21-4e5c-981e-389fe4a4beed. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Acquiring lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Successfully updated port: 305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquired lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received event network-changed-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Refreshing instance network info cache due to event network-changed-57b1674a-e229-46ea-ba3e-2b8d57a9b518. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Acquiring lock "refresh_cache-8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updating instance_info_cache with network_info: [{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Releasing lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance network_info: |[{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Acquired lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Refreshing network info cache for port cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Start _get_guest_xml network_info=[{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Successfully updated port: 592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-437502509',display_name='tempest-AttachVolumeTestJSON-server-437502509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-437502509',id=2,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw==',key_name='tempest-keypair-94073184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-k6t0eual',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=71a9d20f-e79b-4716-abf8-a15330742167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.objects.instance [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'pci_devices' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquired lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:02 user nova-compute[75257]:   <uuid>71a9d20f-e79b-4716-abf8-a15330742167</uuid>
Nov 14 02:06:02 user nova-compute[75257]:   <name>instance-00000002</name>
Nov 14 02:06:02 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:02 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:02 user nova-compute[75257]:   <metadata>
Nov 14 02:06:02 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:02 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:02 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeTestJSON-server-437502509</nova:name>
Nov 14 02:06:02 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:02</nova:creationTime>
Nov 14 02:06:02 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:02 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:02 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:02 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:02 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:02 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:02 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:02 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:02 user nova-compute[75257]:         <nova:user uuid="4002c20dcbc94a8ea540419f20f8621e">tempest-AttachVolumeTestJSON-1670713184-project-member</nova:user>
Nov 14 02:06:02 user nova-compute[75257]:         <nova:project uuid="246dd4dc2106412bb0ca5e71670d9557">tempest-AttachVolumeTestJSON-1670713184</nova:project>
Nov 14 02:06:02 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:02 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:06:02 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:02 user nova-compute[75257]:         <nova:port uuid="cc019053-7c21-4e5c-981e-389fe4a4beed">
Nov 14 02:06:02 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 02:06:02 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:02 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:02 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:02 user nova-compute[75257]:   </metadata>
Nov 14 02:06:02 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:02 user nova-compute[75257]:     <system>
Nov 14 02:06:02 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:02 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:02 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:02 user nova-compute[75257]:       <entry name="serial">71a9d20f-e79b-4716-abf8-a15330742167</entry>
Nov 14 02:06:02 user nova-compute[75257]:       <entry name="uuid">71a9d20f-e79b-4716-abf8-a15330742167</entry>
Nov 14 02:06:02 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:02 user nova-compute[75257]:     </system>
Nov 14 02:06:02 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:02 user nova-compute[75257]:   <os>
Nov 14 02:06:02 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:02 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:02 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:02 user nova-compute[75257]:   </os>
Nov 14 02:06:02 user nova-compute[75257]:   <features>
Nov 14 02:06:02 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:02 user nova-compute[75257]:     <apic/>
Nov 14 02:06:02 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:02 user nova-compute[75257]:   </features>
Nov 14 02:06:02 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:02 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:02 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:02 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:02 user nova-compute[75257]:   </clock>
Nov 14 02:06:02 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:02 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:02 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:02 user nova-compute[75257]:   </cpu>
Nov 14 02:06:02 user nova-compute[75257]:   <devices>
Nov 14 02:06:02 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:06:02 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:06:02 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk"/>
Nov 14 02:06:02 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:06:02 user nova-compute[75257]:     </disk>
Nov 14 02:06:02 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:02 user nova-compute[75257]:       <mac address="fa:16:3e:69:41:ac"/>
Nov 14 02:06:02 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:02 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:02 user nova-compute[75257]:       <target dev="tapcc019053-7c"/>
Nov 14 02:06:02 user nova-compute[75257]:     </interface>
Nov 14 02:06:02 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:02 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/console.log" append="off"/>
Nov 14 02:06:02 user nova-compute[75257]:     </serial>
Nov 14 02:06:02 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:02 user nova-compute[75257]:     <video>
Nov 14 02:06:02 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:02 user nova-compute[75257]:     </video>
Nov 14 02:06:02 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:02 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:02 user nova-compute[75257]:     </rng>
Nov 14 02:06:02 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:02 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:02 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:02 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:02 user nova-compute[75257]:   </devices>
Nov 14 02:06:02 user nova-compute[75257]: </domain>
Nov 14 02:06:02 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-437502509',display_name='tempest-AttachVolumeTestJSON-server-437502509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-437502509',id=2,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw==',key_name='tempest-keypair-94073184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-k6t0eual',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=71a9d20f-e79b-4716-abf8-a15330742167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG os_vif [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Created schema index Interface.name {{(pid=75257) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Created schema index Port.name {{(pid=75257) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Created schema index Bridge.name {{(pid=75257) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [POLLOUT] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a61d4ccd-5716-5aa3-aa4c-ed448c97684b', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:02 user nova-compute[75257]: INFO oslo.privsep.daemon [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpmxa2wsbn/privsep.sock']
Nov 14 02:06:02 user sudo[84671]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpmxa2wsbn/privsep.sock
Nov 14 02:06:02 user sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 02:06:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updating instance_info_cache with network_info: [{"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Releasing lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Instance network_info: |[{"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Start _get_guest_xml network_info=[{"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1338652237',display_name='tempest-ServerActionsTestOtherA-server-1338652237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1338652237',id=5,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww==',key_name='tempest-keypair-1627475945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-4x0drdu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:80:0c,bridge_name='br-int',has_traffic_filtering=True,id=305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305a143e-a7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.objects.instance [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Updating instance_info_cache with network_info: [{"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:03 user nova-compute[75257]:   <uuid>0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9</uuid>
Nov 14 02:06:03 user nova-compute[75257]:   <name>instance-00000005</name>
Nov 14 02:06:03 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:03 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:03 user nova-compute[75257]:   <metadata>
Nov 14 02:06:03 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:03 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:name>tempest-ServerActionsTestOtherA-server-1338652237</nova:name>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:03</nova:creationTime>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:03 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:03 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:user uuid="7ffa5574e531479993ef301510f1d9e3">tempest-ServerActionsTestOtherA-1988221692-project-member</nova:user>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:project uuid="a1ba9547629f4ea1b40424e277e17d25">tempest-ServerActionsTestOtherA-1988221692</nova:project>
Nov 14 02:06:03 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:port uuid="305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c">
Nov 14 02:06:03 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 02:06:03 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:03 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:03 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:03 user nova-compute[75257]:   </metadata>
Nov 14 02:06:03 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:03 user nova-compute[75257]:     <system>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="serial">0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="uuid">0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:03 user nova-compute[75257]:     </system>
Nov 14 02:06:03 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:03 user nova-compute[75257]:   <os>
Nov 14 02:06:03 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:03 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:03 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:03 user nova-compute[75257]:   </os>
Nov 14 02:06:03 user nova-compute[75257]:   <features>
Nov 14 02:06:03 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:03 user nova-compute[75257]:     <apic/>
Nov 14 02:06:03 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:03 user nova-compute[75257]:   </features>
Nov 14 02:06:03 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:03 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:03 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:03 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:03 user nova-compute[75257]:   </clock>
Nov 14 02:06:03 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:03 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:03 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:03 user nova-compute[75257]:   </cpu>
Nov 14 02:06:03 user nova-compute[75257]:   <devices>
Nov 14 02:06:03 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:06:03 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:06:03 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk"/>
Nov 14 02:06:03 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:06:03 user nova-compute[75257]:     </disk>
Nov 14 02:06:03 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:03 user nova-compute[75257]:       <mac address="fa:16:3e:a7:80:0c"/>
Nov 14 02:06:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:03 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:03 user nova-compute[75257]:       <target dev="tap305a143e-a7"/>
Nov 14 02:06:03 user nova-compute[75257]:     </interface>
Nov 14 02:06:03 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:03 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/console.log" append="off"/>
Nov 14 02:06:03 user nova-compute[75257]:     </serial>
Nov 14 02:06:03 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:03 user nova-compute[75257]:     <video>
Nov 14 02:06:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:03 user nova-compute[75257]:     </video>
Nov 14 02:06:03 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:03 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:03 user nova-compute[75257]:     </rng>
Nov 14 02:06:03 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:03 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:03 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:03 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:03 user nova-compute[75257]:   </devices>
Nov 14 02:06:03 user nova-compute[75257]: </domain>
Nov 14 02:06:03 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1338652237',display_name='tempest-ServerActionsTestOtherA-server-1338652237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1338652237',id=5,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww==',key_name='tempest-keypair-1627475945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-4x0drdu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:80:0c,bridge_name='br-int',has_traffic_filtering=True,id=305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305a143e-a7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG os_vif [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:80:0c,bridge_name='br-int',has_traffic_filtering=True,id=305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305a143e-a7') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9939072-5cd1-5a5a-b0be-61722c446ba3', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Releasing lock "refresh_cache-8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Instance network_info: |[{"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Acquired lock "refresh_cache-8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Refreshing network info cache for port 57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Start _get_guest_xml network_info=[{"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-42747156',display_name='tempest-DeleteServersTestJSON-server-42747156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-42747156',id=1,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be0fe3e87f6d484f8f205662dcc31a4b',ramdisk_id='',reservation_id='r-cnhikt9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-204082231',owner_user_name='tempest-DeleteServersTestJSON-204082231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:56Z,user_data=None,user_id='5ca1c02f69824ccabfbf9ada3f202403',uuid=8344b1ae-c8b7-4b30-b88e-9b554b5d3dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Converting VIF {"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=57b1674a-e229-46ea-ba3e-2b8d57a9b518,network=Network(0ce4ee69-8517-419c-a70e-bfa199241285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b1674a-e2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lazy-loading 'pci_devices' on Instance uuid 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:03 user nova-compute[75257]:   <uuid>8344b1ae-c8b7-4b30-b88e-9b554b5d3dba</uuid>
Nov 14 02:06:03 user nova-compute[75257]:   <name>instance-00000001</name>
Nov 14 02:06:03 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:03 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:03 user nova-compute[75257]:   <metadata>
Nov 14 02:06:03 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:03 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:name>tempest-DeleteServersTestJSON-server-42747156</nova:name>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:03</nova:creationTime>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:03 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:03 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:user uuid="5ca1c02f69824ccabfbf9ada3f202403">tempest-DeleteServersTestJSON-204082231-project-member</nova:user>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:project uuid="be0fe3e87f6d484f8f205662dcc31a4b">tempest-DeleteServersTestJSON-204082231</nova:project>
Nov 14 02:06:03 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:port uuid="57b1674a-e229-46ea-ba3e-2b8d57a9b518">
Nov 14 02:06:03 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 02:06:03 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:03 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:03 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:03 user nova-compute[75257]:   </metadata>
Nov 14 02:06:03 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:03 user nova-compute[75257]:     <system>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="serial">8344b1ae-c8b7-4b30-b88e-9b554b5d3dba</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="uuid">8344b1ae-c8b7-4b30-b88e-9b554b5d3dba</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:03 user nova-compute[75257]:     </system>
Nov 14 02:06:03 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:03 user nova-compute[75257]:   <os>
Nov 14 02:06:03 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:03 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:03 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:03 user nova-compute[75257]:   </os>
Nov 14 02:06:03 user nova-compute[75257]:   <features>
Nov 14 02:06:03 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:03 user nova-compute[75257]:     <apic/>
Nov 14 02:06:03 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:03 user nova-compute[75257]:   </features>
Nov 14 02:06:03 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:03 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:03 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:03 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:03 user nova-compute[75257]:   </clock>
Nov 14 02:06:03 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:03 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:03 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:03 user nova-compute[75257]:   </cpu>
Nov 14 02:06:03 user nova-compute[75257]:   <devices>
Nov 14 02:06:03 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:06:03 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:06:03 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk"/>
Nov 14 02:06:03 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:06:03 user nova-compute[75257]:     </disk>
Nov 14 02:06:03 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:03 user nova-compute[75257]:       <mac address="fa:16:3e:cc:f8:11"/>
Nov 14 02:06:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:03 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:03 user nova-compute[75257]:       <target dev="tap57b1674a-e2"/>
Nov 14 02:06:03 user nova-compute[75257]:     </interface>
Nov 14 02:06:03 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:03 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/console.log" append="off"/>
Nov 14 02:06:03 user nova-compute[75257]:     </serial>
Nov 14 02:06:03 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:03 user nova-compute[75257]:     <video>
Nov 14 02:06:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:03 user nova-compute[75257]:     </video>
Nov 14 02:06:03 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:03 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:03 user nova-compute[75257]:     </rng>
Nov 14 02:06:03 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:03 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:03 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:03 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:03 user nova-compute[75257]:   </devices>
Nov 14 02:06:03 user nova-compute[75257]: </domain>
Nov 14 02:06:03 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-42747156',display_name='tempest-DeleteServersTestJSON-server-42747156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-42747156',id=1,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be0fe3e87f6d484f8f205662dcc31a4b',ramdisk_id='',reservation_id='r-cnhikt9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-204082231',owner_user_name='tempest-DeleteServersTestJSON-204082231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:56Z,user_data=None,user_id='5ca1c02f69824ccabfbf9ada3f202403',uuid=8344b1ae-c8b7-4b30-b88e-9b554b5d3dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Converting VIF {"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=57b1674a-e229-46ea-ba3e-2b8d57a9b518,network=Network(0ce4ee69-8517-419c-a70e-bfa199241285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b1674a-e2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG os_vif [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=57b1674a-e229-46ea-ba3e-2b8d57a9b518,network=Network(0ce4ee69-8517-419c-a70e-bfa199241285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b1674a-e2') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c645c46e-af02-5075-a102-cefce58bd030', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Successfully updated port: 8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquired lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updated VIF entry in instance network info cache for port cc019053-7c21-4e5c-981e-389fe4a4beed. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updating instance_info_cache with network_info: [{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-453080a0-5612-46d9-983e-f333f1812910 req-a1bd8149-3154-4141-ad6b-22947d52b825 service nova] Releasing lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Updating instance_info_cache with network_info: [{"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Releasing lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Instance network_info: |[{"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Start _get_guest_xml network_info=[{"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1271828340',display_name='tempest-ServersNegativeTestJSON-server-1271828340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1271828340',id=3,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df2958ade8524b6e9c245384d7fe9b92',ramdisk_id='',reservation_id='r-5zcyqpa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1705676333',owner_user_name='tempest-ServersNegativeTestJSON-1705676333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:58Z,user_data=None,user_id='1bf2a54e5cb84e16b3218e3ca1f2fbdc',uuid=2f9df98c-7814-419d-8821-d8c571972f0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converting VIF {"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:50:2e,bridge_name='br-int',has_traffic_filtering=True,id=592113b0-b777-4a01-ac6c-d5337e7d773a,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592113b0-b7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.objects.instance [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f9df98c-7814-419d-8821-d8c571972f0e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:03 user nova-compute[75257]:   <uuid>2f9df98c-7814-419d-8821-d8c571972f0e</uuid>
Nov 14 02:06:03 user nova-compute[75257]:   <name>instance-00000003</name>
Nov 14 02:06:03 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:03 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:03 user nova-compute[75257]:   <metadata>
Nov 14 02:06:03 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:03 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:name>tempest-ServersNegativeTestJSON-server-1271828340</nova:name>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:03</nova:creationTime>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:03 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:03 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:user uuid="1bf2a54e5cb84e16b3218e3ca1f2fbdc">tempest-ServersNegativeTestJSON-1705676333-project-member</nova:user>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:project uuid="df2958ade8524b6e9c245384d7fe9b92">tempest-ServersNegativeTestJSON-1705676333</nova:project>
Nov 14 02:06:03 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:06:03 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:03 user nova-compute[75257]:         <nova:port uuid="592113b0-b777-4a01-ac6c-d5337e7d773a">
Nov 14 02:06:03 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 02:06:03 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:03 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:03 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:03 user nova-compute[75257]:   </metadata>
Nov 14 02:06:03 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:03 user nova-compute[75257]:     <system>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="serial">2f9df98c-7814-419d-8821-d8c571972f0e</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="uuid">2f9df98c-7814-419d-8821-d8c571972f0e</entry>
Nov 14 02:06:03 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:03 user nova-compute[75257]:     </system>
Nov 14 02:06:03 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:03 user nova-compute[75257]:   <os>
Nov 14 02:06:03 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:03 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:03 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:03 user nova-compute[75257]:   </os>
Nov 14 02:06:03 user nova-compute[75257]:   <features>
Nov 14 02:06:03 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:03 user nova-compute[75257]:     <apic/>
Nov 14 02:06:03 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:03 user nova-compute[75257]:   </features>
Nov 14 02:06:03 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:03 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:03 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:03 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:03 user nova-compute[75257]:   </clock>
Nov 14 02:06:03 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:03 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:03 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:03 user nova-compute[75257]:   </cpu>
Nov 14 02:06:03 user nova-compute[75257]:   <devices>
Nov 14 02:06:03 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:06:03 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:06:03 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk"/>
Nov 14 02:06:03 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:06:03 user nova-compute[75257]:     </disk>
Nov 14 02:06:03 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:03 user nova-compute[75257]:       <mac address="fa:16:3e:e3:50:2e"/>
Nov 14 02:06:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:03 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:03 user nova-compute[75257]:       <target dev="tap592113b0-b7"/>
Nov 14 02:06:03 user nova-compute[75257]:     </interface>
Nov 14 02:06:03 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:03 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/console.log" append="off"/>
Nov 14 02:06:03 user nova-compute[75257]:     </serial>
Nov 14 02:06:03 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:03 user nova-compute[75257]:     <video>
Nov 14 02:06:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:03 user nova-compute[75257]:     </video>
Nov 14 02:06:03 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:03 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:03 user nova-compute[75257]:     </rng>
Nov 14 02:06:03 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:03 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:03 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:03 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:03 user nova-compute[75257]:   </devices>
Nov 14 02:06:03 user nova-compute[75257]: </domain>
Nov 14 02:06:03 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1271828340',display_name='tempest-ServersNegativeTestJSON-server-1271828340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1271828340',id=3,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df2958ade8524b6e9c245384d7fe9b92',ramdisk_id='',reservation_id='r-5zcyqpa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1705676333',owner_user_name='tempest-ServersNegativeTestJSON-1705676333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:58Z,user_data=None,user_id='1bf2a54e5cb84e16b3218e3ca1f2fbdc',uuid=2f9df98c-7814-419d-8821-d8c571972f0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converting VIF {"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:50:2e,bridge_name='br-int',has_traffic_filtering=True,id=592113b0-b777-4a01-ac6c-d5337e7d773a,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592113b0-b7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG os_vif [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:50:2e,bridge_name='br-int',has_traffic_filtering=True,id=592113b0-b777-4a01-ac6c-d5337e7d773a,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592113b0-b7') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3051045d-e2ad-52d7-9d0c-cd33baaf8cf4', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received event network-changed-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Refreshing instance network info cache due to event network-changed-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Acquiring lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Acquired lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.network.neutron [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Refreshing network info cache for port 305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:04 user sudo[84671]: pam_unix(sudo:session): session closed for user root
Nov 14 02:06:04 user nova-compute[75257]: INFO oslo.privsep.daemon [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Spawned new privsep daemon via rootwrap
Nov 14 02:06:04 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 02:06:04 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 02:06:04 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 02:06:04 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84678
Nov 14 02:06:04 user nova-compute[75257]: WARNING oslo_privsep.priv_context [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] privsep daemon already running
Nov 14 02:06:04 user nova-compute[75257]: WARNING oslo_privsep.priv_context [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] privsep daemon already running
Nov 14 02:06:04 user nova-compute[75257]: WARNING oslo_privsep.priv_context [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] privsep daemon already running
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received event network-changed-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Refreshing instance network info cache due to event network-changed-592113b0-b777-4a01-ac6c-d5337e7d773a. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Acquiring lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Acquired lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.network.neutron [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Refreshing network info cache for port 592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.network.neutron [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Updated VIF entry in instance network info cache for port 57b1674a-e229-46ea-ba3e-2b8d57a9b518. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.network.neutron [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Updating instance_info_cache with network_info: [{"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-687a9d0b-9845-4ce5-9a1d-dd0e14cff65d req-d5624419-e90a-434e-99b4-fe4e59482fb7 service nova] Releasing lock "refresh_cache-8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap305a143e-a7, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap305a143e-a7, col_values=(('qos', UUID('736814b8-239b-4777-9728-69d2d42a1006')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap305a143e-a7, col_values=(('external_ids', {'iface-id': '305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:80:0c', 'vm-uuid': '0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: INFO os_vif [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:80:0c,bridge_name='br-int',has_traffic_filtering=True,id=305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305a143e-a7')
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap592113b0-b7, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap592113b0-b7, col_values=(('qos', UUID('6529333e-7612-4312-9782-e5ce3676b4ed')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap592113b0-b7, col_values=(('external_ids', {'iface-id': '592113b0-b777-4a01-ac6c-d5337e7d773a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:50:2e', 'vm-uuid': '2f9df98c-7814-419d-8821-d8c571972f0e'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: INFO os_vif [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:50:2e,bridge_name='br-int',has_traffic_filtering=True,id=592113b0-b777-4a01-ac6c-d5337e7d773a,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592113b0-b7')
Nov 14 02:06:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57b1674a-e2, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57b1674a-e2, col_values=(('qos', UUID('687b21df-1905-4f2c-936e-885223a649fe')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57b1674a-e2, col_values=(('external_ids', {'iface-id': '57b1674a-e229-46ea-ba3e-2b8d57a9b518', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f8:11', 'vm-uuid': '8344b1ae-c8b7-4b30-b88e-9b554b5d3dba'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Releasing lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Instance network_info: |[{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Start _get_guest_xml network_info=[{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: INFO os_vif [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=57b1674a-e229-46ea-ba3e-2b8d57a9b518,network=Network(0ce4ee69-8517-419c-a70e-bfa199241285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b1674a-e2')
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc019053-7c, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc019053-7c, col_values=(('qos', UUID('0643a472-7c69-4745-a02e-81f3c6e4c3d9')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc019053-7c, col_values=(('external_ids', {'iface-id': 'cc019053-7c21-4e5c-981e-389fe4a4beed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:41:ac', 'vm-uuid': '71a9d20f-e79b-4716-abf8-a15330742167'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:05 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No VIF found with MAC fa:16:3e:a7:80:0c, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1579375628',display_name='tempest-ServerStableDeviceRescueTest-server-1579375628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1579375628',id=4,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq7oRF6OXXfz/US7S5M/p/e15didQje182FxTBE9gXxDXx7o0EBCTENzobqIRSryWT181xbmOLIIMJAJVc0DG69fsUd13H6dI+0Clcf6sFNLQBtvOE6JrQMPFfhuLmNrg==',key_name='tempest-keypair-1863826463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c82a8c1198544448e57221af68aa01e',ramdisk_id='',reservation_id='r-b9n4kmvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2053742251',owner_user_name='tempest-ServerStableDeviceRescueTest-2053742251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='684b5b76244349489205840fb9b4e39d',uuid=b9b5a6d0-1304-49c1-90fb-5964d56885c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Converting VIF {"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:71:d6,bridge_name='br-int',has_traffic_filtering=True,id=8fe0bc37-945a-433d-8dd0-43514dce6f99,network=Network(5919d81b-1969-4559-82b3-6497f0571caa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe0bc37-94') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'pci_devices' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: INFO os_vif [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c')
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:05 user nova-compute[75257]:   <uuid>b9b5a6d0-1304-49c1-90fb-5964d56885c8</uuid>
Nov 14 02:06:05 user nova-compute[75257]:   <name>instance-00000004</name>
Nov 14 02:06:05 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:05 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:05 user nova-compute[75257]:   <metadata>
Nov 14 02:06:05 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:05 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:05 user nova-compute[75257]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1579375628</nova:name>
Nov 14 02:06:05 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:05</nova:creationTime>
Nov 14 02:06:05 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:05 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:05 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:05 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:05 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:05 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:05 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:05 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:05 user nova-compute[75257]:         <nova:user uuid="684b5b76244349489205840fb9b4e39d">tempest-ServerStableDeviceRescueTest-2053742251-project-member</nova:user>
Nov 14 02:06:05 user nova-compute[75257]:         <nova:project uuid="3c82a8c1198544448e57221af68aa01e">tempest-ServerStableDeviceRescueTest-2053742251</nova:project>
Nov 14 02:06:05 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:05 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:06:05 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:05 user nova-compute[75257]:         <nova:port uuid="8fe0bc37-945a-433d-8dd0-43514dce6f99">
Nov 14 02:06:05 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 02:06:05 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:05 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:05 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:05 user nova-compute[75257]:   </metadata>
Nov 14 02:06:05 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:05 user nova-compute[75257]:     <system>
Nov 14 02:06:05 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:05 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:05 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:05 user nova-compute[75257]:       <entry name="serial">b9b5a6d0-1304-49c1-90fb-5964d56885c8</entry>
Nov 14 02:06:05 user nova-compute[75257]:       <entry name="uuid">b9b5a6d0-1304-49c1-90fb-5964d56885c8</entry>
Nov 14 02:06:05 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:05 user nova-compute[75257]:     </system>
Nov 14 02:06:05 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:05 user nova-compute[75257]:   <os>
Nov 14 02:06:05 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:05 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:05 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:05 user nova-compute[75257]:   </os>
Nov 14 02:06:05 user nova-compute[75257]:   <features>
Nov 14 02:06:05 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:05 user nova-compute[75257]:     <apic/>
Nov 14 02:06:05 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:05 user nova-compute[75257]:   </features>
Nov 14 02:06:05 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:05 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:05 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:05 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:05 user nova-compute[75257]:   </clock>
Nov 14 02:06:05 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:05 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:05 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:05 user nova-compute[75257]:   </cpu>
Nov 14 02:06:05 user nova-compute[75257]:   <devices>
Nov 14 02:06:05 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:06:05 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:06:05 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk"/>
Nov 14 02:06:05 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:06:05 user nova-compute[75257]:     </disk>
Nov 14 02:06:05 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:05 user nova-compute[75257]:       <mac address="fa:16:3e:88:71:d6"/>
Nov 14 02:06:05 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:05 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:05 user nova-compute[75257]:       <target dev="tap8fe0bc37-94"/>
Nov 14 02:06:05 user nova-compute[75257]:     </interface>
Nov 14 02:06:05 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:05 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/console.log" append="off"/>
Nov 14 02:06:05 user nova-compute[75257]:     </serial>
Nov 14 02:06:05 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:05 user nova-compute[75257]:     <video>
Nov 14 02:06:05 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:05 user nova-compute[75257]:     </video>
Nov 14 02:06:05 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:05 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:05 user nova-compute[75257]:     </rng>
Nov 14 02:06:05 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:05 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:05 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:05 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:05 user nova-compute[75257]:   </devices>
Nov 14 02:06:05 user nova-compute[75257]: </domain>
Nov 14 02:06:05 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1579375628',display_name='tempest-ServerStableDeviceRescueTest-server-1579375628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1579375628',id=4,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq7oRF6OXXfz/US7S5M/p/e15didQje182FxTBE9gXxDXx7o0EBCTENzobqIRSryWT181xbmOLIIMJAJVc0DG69fsUd13H6dI+0Clcf6sFNLQBtvOE6JrQMPFfhuLmNrg==',key_name='tempest-keypair-1863826463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c82a8c1198544448e57221af68aa01e',ramdisk_id='',reservation_id='r-b9n4kmvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2053742251',owner_user_name='tempest-ServerStableDeviceRescueTest-2053742251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='684b5b76244349489205840fb9b4e39d',uuid=b9b5a6d0-1304-49c1-90fb-5964d56885c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Converting VIF {"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:71:d6,bridge_name='br-int',has_traffic_filtering=True,id=8fe0bc37-945a-433d-8dd0-43514dce6f99,network=Network(5919d81b-1969-4559-82b3-6497f0571caa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe0bc37-94') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG os_vif [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:71:d6,bridge_name='br-int',has_traffic_filtering=True,id=8fe0bc37-945a-433d-8dd0-43514dce6f99,network=Network(5919d81b-1969-4559-82b3-6497f0571caa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe0bc37-94') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bbb82ed-1b1f-546d-9018-9bbbaf099691', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] No VIF found with MAC fa:16:3e:e3:50:2e, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] No VIF found with MAC fa:16:3e:cc:f8:11, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fe0bc37-94, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fe0bc37-94, col_values=(('qos', UUID('c41c77f6-ba71-416e-9202-228b05a39e6e')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fe0bc37-94, col_values=(('external_ids', {'iface-id': '8fe0bc37-945a-433d-8dd0-43514dce6f99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:71:d6', 'vm-uuid': 'b9b5a6d0-1304-49c1-90fb-5964d56885c8'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No VIF found with MAC fa:16:3e:69:41:ac, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: INFO os_vif [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:71:d6,bridge_name='br-int',has_traffic_filtering=True,id=8fe0bc37-945a-433d-8dd0-43514dce6f99,network=Network(5919d81b-1969-4559-82b3-6497f0571caa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe0bc37-94')
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] No VIF found with MAC fa:16:3e:88:71:d6, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.network.neutron [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updated VIF entry in instance network info cache for port 305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG nova.network.neutron [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updating instance_info_cache with network_info: [{"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e3f6af35-3b49-4e73-9f1f-e98a7fd315af req-de41dbf0-d95b-4b58-a65f-23cbde662dec service nova] Releasing lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Updated VIF entry in instance network info cache for port 592113b0-b777-4a01-ac6c-d5337e7d773a. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Updating instance_info_cache with network_info: [{"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Releasing lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-changed-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Refreshing instance network info cache due to event network-changed-8fe0bc37-945a-433d-8dd0-43514dce6f99. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Acquiring lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Acquired lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Refreshing network info cache for port 8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:07 user nova-compute[75257]: DEBUG nova.network.neutron [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updated VIF entry in instance network info cache for port 8fe0bc37-945a-433d-8dd0-43514dce6f99. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:07 user nova-compute[75257]: DEBUG nova.network.neutron [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3b0f80b8-b8b8-4f4f-9c31-f8598c069613 req-558fffca-95ca-435b-a7a6-a7f3ce484a2d service nova] Releasing lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:06:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received event network-vif-plugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] Acquiring lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] No waiting events found dispatching network-vif-plugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:13 user nova-compute[75257]: WARNING nova.compute.manager [req-1728463a-a528-4836-9a2b-b740d810d585 req-d261d9e9-01a6-40f6-baa9-07e0136c52e0 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received unexpected event network-vif-plugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance with vm_state building and task_state spawning.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.claims [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Claim successful on node user
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Instance spawned successfully.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Instance spawned successfully.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Instance spawned successfully.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Took 15.95 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Took 15.45 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance spawned successfully.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Instance spawned successfully.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Took 17.96 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.manager [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Took 17.33 seconds to build instance.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.manager [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Took 17.27 seconds to build instance.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b5051e9f-f8a0-4714-b907-d6471fc2d124 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.836s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c61455f4-7ffe-4468-9bda-563584e57615 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.407s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.404s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.manager [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Took 19.35 seconds to build instance.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.423s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Took 17.63 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.claims [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Claim successful on node user
Nov 14 02:06:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5733186-818d-446f-81f2-40db682234d7 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.597s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Took 17.00 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:14 user nova-compute[75257]: INFO nova.compute.manager [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Took 19.17 seconds to build instance.
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:06:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-646d6482-3d6c-43b1-9fdf-7d7b9004663c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.313s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:15 user nova-compute[75257]: INFO nova.compute.manager [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Took 19.29 seconds to build instance.
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-404f76f6-08e1-4aa3-ae0d-b3fc360afd73 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "2f9df98c-7814-419d-8821-d8c571972f0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.517s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received event network-vif-plugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] Acquiring lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] No waiting events found dispatching network-vif-plugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:15 user nova-compute[75257]: WARNING nova.compute.manager [req-7c096e2a-3e09-4633-8fda-77b2221bfa1f req-e92615a7-1f74-464a-8dc0-7df7b2066ee5 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received unexpected event network-vif-plugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance with vm_state active and task_state None.
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.policy [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e4dbe6bba744f4cabba17fcbea21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4120a890b64ac9abb385f0ba8d3447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:06:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Creating image(s)
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "/opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "/opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.266s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.997s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:06:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 02:06:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.332s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk 1073741824" returned: 0 in 0.086s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.437s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG nova.policy [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6812b41d5b0f4a35b22dec35cd0d44c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fe8be09f614bfcb6ea1bfc3adef743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:06:16 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Creating image(s)
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "/opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "/opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "5bb10a1c0a37b862cc07a721c28c0924f415347c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "5bb10a1c0a37b862cc07a721c28c0924f415347c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.376s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:06:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.747s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Cannot resize image /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Ensure instance console log exists: /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.025s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c.part --force-share --output=json" returned: 0 in 0.345s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG nova.virt.images [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1 was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c.part /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Successfully created port: e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c.part /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c.converted" returned: 0 in 0.742s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received event network-vif-plugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] Acquiring lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] No waiting events found dispatching network-vif-plugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:18 user nova-compute[75257]: WARNING nova.compute.manager [req-2fa1ff4e-4d26-4f70-98c4-a186b08da26f req-1f66adef-7527-4a9b-8657-6fcc579d5942 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received unexpected event network-vif-plugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance with vm_state active and task_state None.
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c.converted --force-share --output=json" returned: 0 in 0.331s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "5bb10a1c0a37b862cc07a721c28c0924f415347c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.248s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:06:18 user nova-compute[75257]: INFO nova.compute.claims [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Claim successful on node user
Nov 14 02:06:18 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Successfully created port: aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c --force-share --output=json" returned: 0 in 0.338s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "5bb10a1c0a37b862cc07a721c28c0924f415347c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "5bb10a1c0a37b862cc07a721c28c0924f415347c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c --force-share --output=json" returned: 0 in 0.320s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c,backing_fmt=raw /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c,backing_fmt=raw /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk 1073741824" returned: 0 in 0.099s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "5bb10a1c0a37b862cc07a721c28c0924f415347c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.438s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c --force-share --output=json" returned: 0 in 0.263s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Successfully updated port: e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "refresh_cache-0bbd75fc-a135-4bc6-8853-e28dfc6219c1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquired lock "refresh_cache-0bbd75fc-a135-4bc6-8853-e28dfc6219c1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Cannot resize image /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Ensure instance console log exists: /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:19 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.360s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.network.neutron [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:06:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Successfully updated port: aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "refresh_cache-fd62b270-19d7-45e5-bd66-a94c384050bd" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquired lock "refresh_cache-fd62b270-19d7-45e5-bd66-a94c384050bd" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received event network-changed-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Refreshing instance network info cache due to event network-changed-aa2867e8-4cfe-415e-96a1-881199b73c4c. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] Acquiring lock "refresh_cache-fd62b270-19d7-45e5-bd66-a94c384050bd" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:20 user nova-compute[75257]: DEBUG nova.policy [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received event network-vif-plugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Acquiring lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] No waiting events found dispatching network-vif-plugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:21 user nova-compute[75257]: WARNING nova.compute.manager [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received unexpected event network-vif-plugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance with vm_state active and task_state None.
Nov 14 02:06:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received event network-changed-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Refreshing instance network info cache due to event network-changed-e21c8d5d-3420-4c0d-8677-74cc2edef2cf. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Acquiring lock "refresh_cache-0bbd75fc-a135-4bc6-8853-e28dfc6219c1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:06:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Creating image(s)
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.526s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Updating instance_info_cache with network_info: [{"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Releasing lock "refresh_cache-fd62b270-19d7-45e5-bd66-a94c384050bd" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Instance network_info: |[{"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.282s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] Acquired lock "refresh_cache-fd62b270-19d7-45e5-bd66-a94c384050bd" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Refreshing network info cache for port aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Start _get_guest_xml network_info=[{"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:22 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:22 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk 1073741824" returned: 0 in 0.156s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.465s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1824193926',display_name='tempest-VolumesAdminNegativeTest-server-1824193926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1824193926',id=6,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5+yRFEwVQWprnc7ODmeU3bQAwpnqUHzc+F/OioFpEEeae7IQXrZGHZi/lqSuBGwTYoGQL/HLDn56SDAvFoatTPDJemQy33iCCPDbGw0rxPRWy558FvMow3jTEevbrLpw==',key_name='tempest-keypair-1368640699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4120a890b64ac9abb385f0ba8d3447',ramdisk_id='',reservation_id='r-omq347zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1630669709',owner_user_name='tempest-VolumesAdminNegativeTest-1630669709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4dbe6bba744f4cabba17fcbea21c64',uuid=fd62b270-19d7-45e5-bd66-a94c384050bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converting VIF {"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:2e:bd,bridge_name='br-int',has_traffic_filtering=True,id=aa2867e8-4cfe-415e-96a1-881199b73c4c,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2867e8-4c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lazy-loading 'pci_devices' on Instance uuid fd62b270-19d7-45e5-bd66-a94c384050bd {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Updating instance_info_cache with network_info: [{"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:22 user nova-compute[75257]:   <uuid>fd62b270-19d7-45e5-bd66-a94c384050bd</uuid>
Nov 14 02:06:22 user nova-compute[75257]:   <name>instance-00000006</name>
Nov 14 02:06:22 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:22 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:22 user nova-compute[75257]:   <metadata>
Nov 14 02:06:22 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:22 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:22 user nova-compute[75257]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1824193926</nova:name>
Nov 14 02:06:22 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:22</nova:creationTime>
Nov 14 02:06:22 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:22 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:22 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:22 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:22 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:22 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:22 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:22 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:22 user nova-compute[75257]:         <nova:user uuid="9e4dbe6bba744f4cabba17fcbea21c64">tempest-VolumesAdminNegativeTest-1630669709-project-member</nova:user>
Nov 14 02:06:22 user nova-compute[75257]:         <nova:project uuid="2b4120a890b64ac9abb385f0ba8d3447">tempest-VolumesAdminNegativeTest-1630669709</nova:project>
Nov 14 02:06:22 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:22 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:06:22 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:22 user nova-compute[75257]:         <nova:port uuid="aa2867e8-4cfe-415e-96a1-881199b73c4c">
Nov 14 02:06:22 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 02:06:22 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:22 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:22 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:22 user nova-compute[75257]:   </metadata>
Nov 14 02:06:22 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:22 user nova-compute[75257]:     <system>
Nov 14 02:06:22 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:22 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:22 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:22 user nova-compute[75257]:       <entry name="serial">fd62b270-19d7-45e5-bd66-a94c384050bd</entry>
Nov 14 02:06:22 user nova-compute[75257]:       <entry name="uuid">fd62b270-19d7-45e5-bd66-a94c384050bd</entry>
Nov 14 02:06:22 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:22 user nova-compute[75257]:     </system>
Nov 14 02:06:22 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:22 user nova-compute[75257]:   <os>
Nov 14 02:06:22 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:22 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:22 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:22 user nova-compute[75257]:   </os>
Nov 14 02:06:22 user nova-compute[75257]:   <features>
Nov 14 02:06:22 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:22 user nova-compute[75257]:     <apic/>
Nov 14 02:06:22 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:22 user nova-compute[75257]:   </features>
Nov 14 02:06:22 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:22 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:22 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:22 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:22 user nova-compute[75257]:   </clock>
Nov 14 02:06:22 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:22 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:22 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:22 user nova-compute[75257]:   </cpu>
Nov 14 02:06:22 user nova-compute[75257]:   <devices>
Nov 14 02:06:22 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:06:22 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:06:22 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk"/>
Nov 14 02:06:22 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:06:22 user nova-compute[75257]:     </disk>
Nov 14 02:06:22 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:22 user nova-compute[75257]:       <mac address="fa:16:3e:3b:2e:bd"/>
Nov 14 02:06:22 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:22 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:22 user nova-compute[75257]:       <target dev="tapaa2867e8-4c"/>
Nov 14 02:06:22 user nova-compute[75257]:     </interface>
Nov 14 02:06:22 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:22 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/console.log" append="off"/>
Nov 14 02:06:22 user nova-compute[75257]:     </serial>
Nov 14 02:06:22 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:22 user nova-compute[75257]:     <video>
Nov 14 02:06:22 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:22 user nova-compute[75257]:     </video>
Nov 14 02:06:22 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:22 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:22 user nova-compute[75257]:     </rng>
Nov 14 02:06:22 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:22 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:22 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:22 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:22 user nova-compute[75257]:   </devices>
Nov 14 02:06:22 user nova-compute[75257]: </domain>
Nov 14 02:06:22 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1824193926',display_name='tempest-VolumesAdminNegativeTest-server-1824193926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1824193926',id=6,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5+yRFEwVQWprnc7ODmeU3bQAwpnqUHzc+F/OioFpEEeae7IQXrZGHZi/lqSuBGwTYoGQL/HLDn56SDAvFoatTPDJemQy33iCCPDbGw0rxPRWy558FvMow3jTEevbrLpw==',key_name='tempest-keypair-1368640699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4120a890b64ac9abb385f0ba8d3447',ramdisk_id='',reservation_id='r-omq347zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1630669709',owner_user_name='tempest-VolumesAdminNegativeTest-1630669709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4dbe6bba744f4cabba17fcbea21c64',uuid=fd62b270-19d7-45e5-bd66-a94c384050bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converting VIF {"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:2e:bd,bridge_name='br-int',has_traffic_filtering=True,id=aa2867e8-4cfe-415e-96a1-881199b73c4c,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2867e8-4c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG os_vif [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:2e:bd,bridge_name='br-int',has_traffic_filtering=True,id=aa2867e8-4cfe-415e-96a1-881199b73c4c,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2867e8-4c') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.389s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e3fbec6-e433-535e-a7ed-55f307c6efff', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Releasing lock "refresh_cache-0bbd75fc-a135-4bc6-8853-e28dfc6219c1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Instance network_info: |[{"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Acquired lock "refresh_cache-0bbd75fc-a135-4bc6-8853-e28dfc6219c1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Refreshing network info cache for port e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Start _get_guest_xml network_info=[{"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:06:07Z,direct_url=<?>,disk_format='qcow2',id=2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1,min_disk=0,min_ram=0,name='',owner='096f43c070c4492ba06998c1fff89c61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:06:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'image_id': '2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa2867e8-4c, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa2867e8-4c, col_values=(('qos', UUID('e8558909-e629-472c-85a2-bcc495166b66')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa2867e8-4c, col_values=(('external_ids', {'iface-id': 'aa2867e8-4cfe-415e-96a1-881199b73c4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:2e:bd', 'vm-uuid': 'fd62b270-19d7-45e5-bd66-a94c384050bd'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:22 user nova-compute[75257]: INFO os_vif [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:2e:bd,bridge_name='br-int',has_traffic_filtering=True,id=aa2867e8-4cfe-415e-96a1-881199b73c4c,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2867e8-4c')
Nov 14 02:06:22 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:22 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:06:07Z,direct_url=<?>,disk_format='qcow2',id=2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1,min_disk=0,min_ram=0,name='',owner='096f43c070c4492ba06998c1fff89c61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:06:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1645257739',display_name='tempest-AttachSCSIVolumeTestJSON-server-1645257739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1645257739',id=7,image_ref='2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhj4EaeRXfb9NhMQegYPjT/0/LNAZQJ+nyOpv1nCt/fNC2YFkT+WEza0vNVeLKvgisEvUQ1Ac56JE3n49AToodAUPgrNFxkJM6n2fLECVtuDKkZ5iI820bK1yg2l6tSHQ==',key_name='tempest-keypair-1154414656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05fe8be09f614bfcb6ea1bfc3adef743',ramdisk_id='',reservation_id='r-43xuukht',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1301438302',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1301438302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6812b41d5b0f4a35b22dec35cd0d44c6',uuid=0bbd75fc-a135-4bc6-8853-e28dfc6219c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Converting VIF {"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:10:16,bridge_name='br-int',has_traffic_filtering=True,id=e21c8d5d-3420-4c0d-8677-74cc2edef2cf,network=Network(b8a8607b-2c76-4094-9b20-0a1a967b52ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape21c8d5d-34') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json" returned: 0 in 0.495s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:23 user nova-compute[75257]:   <uuid>0bbd75fc-a135-4bc6-8853-e28dfc6219c1</uuid>
Nov 14 02:06:23 user nova-compute[75257]:   <name>instance-00000007</name>
Nov 14 02:06:23 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:23 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:23 user nova-compute[75257]:   <metadata>
Nov 14 02:06:23 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:23 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:23 user nova-compute[75257]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1645257739</nova:name>
Nov 14 02:06:23 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:22</nova:creationTime>
Nov 14 02:06:23 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:23 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:23 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:23 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:23 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:23 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:23 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:23 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:23 user nova-compute[75257]:         <nova:user uuid="6812b41d5b0f4a35b22dec35cd0d44c6">tempest-AttachSCSIVolumeTestJSON-1301438302-project-member</nova:user>
Nov 14 02:06:23 user nova-compute[75257]:         <nova:project uuid="05fe8be09f614bfcb6ea1bfc3adef743">tempest-AttachSCSIVolumeTestJSON-1301438302</nova:project>
Nov 14 02:06:23 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:23 user nova-compute[75257]:       <nova:root type="image" uuid="2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1"/>
Nov 14 02:06:23 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:23 user nova-compute[75257]:         <nova:port uuid="e21c8d5d-3420-4c0d-8677-74cc2edef2cf">
Nov 14 02:06:23 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 02:06:23 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:23 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:23 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:23 user nova-compute[75257]:   </metadata>
Nov 14 02:06:23 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:23 user nova-compute[75257]:     <system>
Nov 14 02:06:23 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:23 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:23 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:23 user nova-compute[75257]:       <entry name="serial">0bbd75fc-a135-4bc6-8853-e28dfc6219c1</entry>
Nov 14 02:06:23 user nova-compute[75257]:       <entry name="uuid">0bbd75fc-a135-4bc6-8853-e28dfc6219c1</entry>
Nov 14 02:06:23 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:23 user nova-compute[75257]:     </system>
Nov 14 02:06:23 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:23 user nova-compute[75257]:   <os>
Nov 14 02:06:23 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:23 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:23 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:23 user nova-compute[75257]:   </os>
Nov 14 02:06:23 user nova-compute[75257]:   <features>
Nov 14 02:06:23 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:23 user nova-compute[75257]:     <apic/>
Nov 14 02:06:23 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:23 user nova-compute[75257]:   </features>
Nov 14 02:06:23 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:23 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:23 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:23 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:23 user nova-compute[75257]:   </clock>
Nov 14 02:06:23 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:23 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:23 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:23 user nova-compute[75257]:   </cpu>
Nov 14 02:06:23 user nova-compute[75257]:   <devices>
Nov 14 02:06:23 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:06:23 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:06:23 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk"/>
Nov 14 02:06:23 user nova-compute[75257]:       <target dev="sda" bus="scsi"/>
Nov 14 02:06:23 user nova-compute[75257]:       <address type="drive" controller="0" unit="0"/>
Nov 14 02:06:23 user nova-compute[75257]:     </disk>
Nov 14 02:06:23 user nova-compute[75257]:     <disk type="file" device="cdrom">
Nov 14 02:06:23 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 02:06:23 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk.config"/>
Nov 14 02:06:23 user nova-compute[75257]:       <target dev="sdb" bus="scsi"/>
Nov 14 02:06:23 user nova-compute[75257]:       <address type="drive" controller="0" unit="1"/>
Nov 14 02:06:23 user nova-compute[75257]:     </disk>
Nov 14 02:06:23 user nova-compute[75257]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 02:06:23 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:23 user nova-compute[75257]:       <mac address="fa:16:3e:de:10:16"/>
Nov 14 02:06:23 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:23 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:23 user nova-compute[75257]:       <target dev="tape21c8d5d-34"/>
Nov 14 02:06:23 user nova-compute[75257]:     </interface>
Nov 14 02:06:23 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:23 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/console.log" append="off"/>
Nov 14 02:06:23 user nova-compute[75257]:     </serial>
Nov 14 02:06:23 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:23 user nova-compute[75257]:     <video>
Nov 14 02:06:23 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:23 user nova-compute[75257]:     </video>
Nov 14 02:06:23 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:23 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:23 user nova-compute[75257]:     </rng>
Nov 14 02:06:23 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:23 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:23 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:23 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:23 user nova-compute[75257]:   </devices>
Nov 14 02:06:23 user nova-compute[75257]: </domain>
Nov 14 02:06:23 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1645257739',display_name='tempest-AttachSCSIVolumeTestJSON-server-1645257739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1645257739',id=7,image_ref='2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhj4EaeRXfb9NhMQegYPjT/0/LNAZQJ+nyOpv1nCt/fNC2YFkT+WEza0vNVeLKvgisEvUQ1Ac56JE3n49AToodAUPgrNFxkJM6n2fLECVtuDKkZ5iI820bK1yg2l6tSHQ==',key_name='tempest-keypair-1154414656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05fe8be09f614bfcb6ea1bfc3adef743',ramdisk_id='',reservation_id='r-43xuukht',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1301438302',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1301438302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6812b41d5b0f4a35b22dec35cd0d44c6',uuid=0bbd75fc-a135-4bc6-8853-e28dfc6219c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Converting VIF {"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:10:16,bridge_name='br-int',has_traffic_filtering=True,id=e21c8d5d-3420-4c0d-8677-74cc2edef2cf,network=Network(b8a8607b-2c76-4094-9b20-0a1a967b52ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape21c8d5d-34') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG os_vif [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:10:16,bridge_name='br-int',has_traffic_filtering=True,id=e21c8d5d-3420-4c0d-8677-74cc2edef2cf,network=Network(b8a8607b-2c76-4094-9b20-0a1a967b52ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape21c8d5d-34') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Cannot resize image /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Ensure instance console log exists: /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:23 user nova-compute[75257]: WARNING nova.compute.manager [req-339602fc-ec74-40d3-a775-dfd1d8cbc43e req-8a3ff8ad-e97f-481a-ad3a-64cacb910dbc service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state active and task_state None.
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd642e872-993d-5fc5-b761-e6b0f1e263ac', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] No VIF found with MAC fa:16:3e:3b:2e:bd, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape21c8d5d-34, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape21c8d5d-34, col_values=(('qos', UUID('8619fba3-8a3e-4e8f-a44e-d3c0438fcdfa')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape21c8d5d-34, col_values=(('external_ids', {'iface-id': 'e21c8d5d-3420-4c0d-8677-74cc2edef2cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:10:16', 'vm-uuid': '0bbd75fc-a135-4bc6-8853-e28dfc6219c1'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:06:23 user nova-compute[75257]: INFO nova.compute.claims [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Claim successful on node user
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: INFO os_vif [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:10:16,bridge_name='br-int',has_traffic_filtering=True,id=e21c8d5d-3420-4c0d-8677-74cc2edef2cf,network=Network(b8a8607b-2c76-4094-9b20-0a1a967b52ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape21c8d5d-34')
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] No BDM found with device name sda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] No VIF found with MAC fa:16:3e:de:10:16, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:23 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Using config drive
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.network.neutron [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Updated VIF entry in instance network info cache for port aa2867e8-4cfe-415e-96a1-881199b73c4c. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG nova.network.neutron [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Updating instance_info_cache with network_info: [{"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e6f3992d-04fe-4ecc-a404-7a9bd2e42c39 req-fa382120-5287-4420-a4d4-82cd30afef34 service nova] Releasing lock "refresh_cache-fd62b270-19d7-45e5-bd66-a94c384050bd" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.175s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:06:24 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:06:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG nova.policy [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90a4a3f1b20246e3b1e50bbd76a498fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da668843b57c40ee9f230c5912bb2709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:06:24 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Creating image(s)
Nov 14 02:06:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "/opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "/opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG nova.network.neutron [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Updated VIF entry in instance network info cache for port e21c8d5d-3420-4c0d-8677-74cc2edef2cf. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG nova.network.neutron [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Updating instance_info_cache with network_info: [{"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Releasing lock "refresh_cache-0bbd75fc-a135-4bc6-8853-e28dfc6219c1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:25 user nova-compute[75257]: WARNING nova.compute.manager [req-b136daed-007f-426e-b3fc-fd535f70b493 req-c4510cf8-6fbe-43ff-a1e5-b1d461fb569d service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state active and task_state None.
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.304s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:25 user nova-compute[75257]: WARNING nova.compute.manager [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state active and task_state None.
Nov 14 02:06:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:25 user nova-compute[75257]: WARNING nova.compute.manager [req-c3e79fe0-417d-486c-970a-fbf203bf8a97 req-cca9382c-478a-4c0f-9657-3a8fa1c6adbd service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state active and task_state None.
Nov 14 02:06:25 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Creating config drive at /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk.config
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm1rqkpli {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.468s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm1rqkpli" returned: 0 in 0.297s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG nova.network.neutron [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Successfully created port: f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk 1073741824" returned: 0 in 0.248s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.722s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG nova.network.neutron [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Successfully created port: fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.513s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Cannot resize image /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Ensure instance console log exists: /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.network.neutron [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Successfully updated port: f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquired lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.network.neutron [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.network.neutron [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received event network-vif-plugged-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] No waiting events found dispatching network-vif-plugged-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:27 user nova-compute[75257]: WARNING nova.compute.manager [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received unexpected event network-vif-plugged-aa2867e8-4cfe-415e-96a1-881199b73c4c for instance with vm_state building and task_state spawning.
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received event network-vif-plugged-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] No waiting events found dispatching network-vif-plugged-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:27 user nova-compute[75257]: WARNING nova.compute.manager [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received unexpected event network-vif-plugged-aa2867e8-4cfe-415e-96a1-881199b73c4c for instance with vm_state building and task_state spawning.
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-changed-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Refreshing instance network info cache due to event network-changed-f0fa855e-494f-4fb7-9c5b-2022578e7a9e. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Acquiring lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.network.neutron [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Successfully updated port: fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "refresh_cache-a1326183-c4cb-40fa-a352-470e2c69cb05" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquired lock "refresh_cache-a1326183-c4cb-40fa-a352-470e2c69cb05" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.network.neutron [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received event network-changed-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Refreshing instance network info cache due to event network-changed-fb5f3206-b474-4ff1-b22a-ec6169264796. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] Acquiring lock "refresh_cache-a1326183-c4cb-40fa-a352-470e2c69cb05" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG nova.network.neutron [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:06:28 user nova-compute[75257]: INFO nova.compute.claims [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Claim successful on node user
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Updating instance_info_cache with network_info: [{"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Releasing lock "refresh_cache-a1326183-c4cb-40fa-a352-470e2c69cb05" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Instance network_info: |[{"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] Acquired lock "refresh_cache-a1326183-c4cb-40fa-a352-470e2c69cb05" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.neutron [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Refreshing network info cache for port fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Start _get_guest_xml network_info=[{"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updating instance_info_cache with network_info: [{"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1913356881',display_name='tempest-VolumesAssistedSnapshotsTest-server-1913356881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1913356881',id=9,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGic6H0CdbSyqWBGVsfiHfK2deh7upIvHfskva2vI9QFGjB0wM99ch4Bmnjjiz/IbnT0KpD62foVYAD+LVpz8dcQuiZCCKbwh3weEBJ4wNafEgEQnWVVxhuPeAEf4PASQ==',key_name='tempest-keypair-1172015827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da668843b57c40ee9f230c5912bb2709',ramdisk_id='',reservation_id='r-fy0dzcng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-762191271',owner_user_name='tempest-VolumesAssistedSnapshotsTest-762191271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90a4a3f1b20246e3b1e50bbd76a498fd',uuid=a1326183-c4cb-40fa-a352-470e2c69cb05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Converting VIF {"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:45:07,bridge_name='br-int',has_traffic_filtering=True,id=fb5f3206-b474-4ff1-b22a-ec6169264796,network=Network(70e9fb82-e77b-420b-90ec-b92382c04f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5f3206-b4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.objects.instance [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lazy-loading 'pci_devices' on Instance uuid a1326183-c4cb-40fa-a352-470e2c69cb05 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Releasing lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Instance network_info: |[{"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Acquired lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.neutron [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Refreshing network info cache for port f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Start _get_guest_xml network_info=[{"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:28 user nova-compute[75257]:   <uuid>a1326183-c4cb-40fa-a352-470e2c69cb05</uuid>
Nov 14 02:06:28 user nova-compute[75257]:   <name>instance-00000009</name>
Nov 14 02:06:28 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:28 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:28 user nova-compute[75257]:   <metadata>
Nov 14 02:06:28 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:28 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1913356881</nova:name>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:28</nova:creationTime>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:28 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:28 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:user uuid="90a4a3f1b20246e3b1e50bbd76a498fd">tempest-VolumesAssistedSnapshotsTest-762191271-project-member</nova:user>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:project uuid="da668843b57c40ee9f230c5912bb2709">tempest-VolumesAssistedSnapshotsTest-762191271</nova:project>
Nov 14 02:06:28 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:port uuid="fb5f3206-b474-4ff1-b22a-ec6169264796">
Nov 14 02:06:28 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 02:06:28 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:28 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:28 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:28 user nova-compute[75257]:   </metadata>
Nov 14 02:06:28 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:28 user nova-compute[75257]:     <system>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="serial">a1326183-c4cb-40fa-a352-470e2c69cb05</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="uuid">a1326183-c4cb-40fa-a352-470e2c69cb05</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:28 user nova-compute[75257]:     </system>
Nov 14 02:06:28 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:28 user nova-compute[75257]:   <os>
Nov 14 02:06:28 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:28 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:28 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:28 user nova-compute[75257]:   </os>
Nov 14 02:06:28 user nova-compute[75257]:   <features>
Nov 14 02:06:28 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:28 user nova-compute[75257]:     <apic/>
Nov 14 02:06:28 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:28 user nova-compute[75257]:   </features>
Nov 14 02:06:28 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:28 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:28 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:28 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:28 user nova-compute[75257]:   </clock>
Nov 14 02:06:28 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:28 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:28 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:28 user nova-compute[75257]:   </cpu>
Nov 14 02:06:28 user nova-compute[75257]:   <devices>
Nov 14 02:06:28 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:06:28 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:06:28 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk"/>
Nov 14 02:06:28 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:06:28 user nova-compute[75257]:     </disk>
Nov 14 02:06:28 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:28 user nova-compute[75257]:       <mac address="fa:16:3e:94:45:07"/>
Nov 14 02:06:28 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:28 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:28 user nova-compute[75257]:       <target dev="tapfb5f3206-b4"/>
Nov 14 02:06:28 user nova-compute[75257]:     </interface>
Nov 14 02:06:28 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:28 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/console.log" append="off"/>
Nov 14 02:06:28 user nova-compute[75257]:     </serial>
Nov 14 02:06:28 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:28 user nova-compute[75257]:     <video>
Nov 14 02:06:28 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:28 user nova-compute[75257]:     </video>
Nov 14 02:06:28 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:28 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:28 user nova-compute[75257]:     </rng>
Nov 14 02:06:28 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:28 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:28 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:28 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:28 user nova-compute[75257]:   </devices>
Nov 14 02:06:28 user nova-compute[75257]: </domain>
Nov 14 02:06:28 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1913356881',display_name='tempest-VolumesAssistedSnapshotsTest-server-1913356881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1913356881',id=9,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGic6H0CdbSyqWBGVsfiHfK2deh7upIvHfskva2vI9QFGjB0wM99ch4Bmnjjiz/IbnT0KpD62foVYAD+LVpz8dcQuiZCCKbwh3weEBJ4wNafEgEQnWVVxhuPeAEf4PASQ==',key_name='tempest-keypair-1172015827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da668843b57c40ee9f230c5912bb2709',ramdisk_id='',reservation_id='r-fy0dzcng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-762191271',owner_user_name='tempest-VolumesAssistedSnapshotsTest-762191271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90a4a3f1b20246e3b1e50bbd76a498fd',uuid=a1326183-c4cb-40fa-a352-470e2c69cb05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Converting VIF {"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:45:07,bridge_name='br-int',has_traffic_filtering=True,id=fb5f3206-b474-4ff1-b22a-ec6169264796,network=Network(70e9fb82-e77b-420b-90ec-b92382c04f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5f3206-b4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG os_vif [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:45:07,bridge_name='br-int',has_traffic_filtering=True,id=fb5f3206-b474-4ff1-b22a-ec6169264796,network=Network(70e9fb82-e77b-420b-90ec-b92382c04f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5f3206-b4') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49f472ff-8a53-52d4-b5d7-34a0a69b721a', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb5f3206-b4, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb5f3206-b4, col_values=(('qos', UUID('e0ce9e89-2159-4863-a8ae-80a7f88e9e93')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb5f3206-b4, col_values=(('external_ids', {'iface-id': 'fb5f3206-b474-4ff1-b22a-ec6169264796', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:45:07', 'vm-uuid': 'a1326183-c4cb-40fa-a352-470e2c69cb05'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: INFO os_vif [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:45:07,bridge_name='br-int',has_traffic_filtering=True,id=fb5f3206-b474-4ff1-b22a-ec6169264796,network=Network(70e9fb82-e77b-420b-90ec-b92382c04f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5f3206-b4')
Nov 14 02:06:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053798230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053798230',id=8,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA==',key_name='tempest-keypair-1715447766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe096d58b812473296c75ad5d3d5c924',ramdisk_id='',reservation_id='r-m0bnejek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1006457440',owner_user_name='tempest-TaggedAttachmentsTest-1006457440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ca1d05e84d74c1ab74521dcc91f3f38',uuid=8de0ee5b-852a-4146-ba87-378181e1cfc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converting VIF {"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=f0fa855e-494f-4fb7-9c5b-2022578e7a9e,network=Network(92fc7073-a06d-44ea-bb1b-c86ace99eec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa855e-49') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.objects.instance [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lazy-loading 'pci_devices' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:28 user nova-compute[75257]:   <uuid>8de0ee5b-852a-4146-ba87-378181e1cfc4</uuid>
Nov 14 02:06:28 user nova-compute[75257]:   <name>instance-00000008</name>
Nov 14 02:06:28 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:28 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:28 user nova-compute[75257]:   <metadata>
Nov 14 02:06:28 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:28 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:name>tempest-device-tagging-server-1053798230</nova:name>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:28</nova:creationTime>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:28 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:28 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:user uuid="3ca1d05e84d74c1ab74521dcc91f3f38">tempest-TaggedAttachmentsTest-1006457440-project-member</nova:user>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:project uuid="fe096d58b812473296c75ad5d3d5c924">tempest-TaggedAttachmentsTest-1006457440</nova:project>
Nov 14 02:06:28 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:06:28 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:28 user nova-compute[75257]:         <nova:port uuid="f0fa855e-494f-4fb7-9c5b-2022578e7a9e">
Nov 14 02:06:28 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:06:28 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:28 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:28 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:28 user nova-compute[75257]:   </metadata>
Nov 14 02:06:28 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:28 user nova-compute[75257]:     <system>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="serial">8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="uuid">8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:06:28 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:28 user nova-compute[75257]:     </system>
Nov 14 02:06:28 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:28 user nova-compute[75257]:   <os>
Nov 14 02:06:28 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:28 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:28 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:28 user nova-compute[75257]:   </os>
Nov 14 02:06:28 user nova-compute[75257]:   <features>
Nov 14 02:06:28 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:28 user nova-compute[75257]:     <apic/>
Nov 14 02:06:28 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:28 user nova-compute[75257]:   </features>
Nov 14 02:06:28 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:28 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:28 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:28 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:28 user nova-compute[75257]:   </clock>
Nov 14 02:06:28 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:28 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:28 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:28 user nova-compute[75257]:   </cpu>
Nov 14 02:06:28 user nova-compute[75257]:   <devices>
Nov 14 02:06:28 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:06:28 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:06:28 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk"/>
Nov 14 02:06:28 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:06:28 user nova-compute[75257]:     </disk>
Nov 14 02:06:28 user nova-compute[75257]:     <disk type="file" device="cdrom">
Nov 14 02:06:28 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 02:06:28 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.config"/>
Nov 14 02:06:28 user nova-compute[75257]:       <target dev="hda" bus="ide"/>
Nov 14 02:06:28 user nova-compute[75257]:     </disk>
Nov 14 02:06:28 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:28 user nova-compute[75257]:       <mac address="fa:16:3e:a2:65:b2"/>
Nov 14 02:06:28 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:28 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:28 user nova-compute[75257]:       <target dev="tapf0fa855e-49"/>
Nov 14 02:06:28 user nova-compute[75257]:     </interface>
Nov 14 02:06:28 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:28 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log" append="off"/>
Nov 14 02:06:28 user nova-compute[75257]:     </serial>
Nov 14 02:06:28 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:28 user nova-compute[75257]:     <video>
Nov 14 02:06:28 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:28 user nova-compute[75257]:     </video>
Nov 14 02:06:28 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:28 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:28 user nova-compute[75257]:     </rng>
Nov 14 02:06:28 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:28 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:28 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:28 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:28 user nova-compute[75257]:   </devices>
Nov 14 02:06:28 user nova-compute[75257]: </domain>
Nov 14 02:06:28 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053798230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053798230',id=8,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA==',key_name='tempest-keypair-1715447766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe096d58b812473296c75ad5d3d5c924',ramdisk_id='',reservation_id='r-m0bnejek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1006457440',owner_user_name='tempest-TaggedAttachmentsTest-1006457440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ca1d05e84d74c1ab74521dcc91f3f38',uuid=8de0ee5b-852a-4146-ba87-378181e1cfc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converting VIF {"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=f0fa855e-494f-4fb7-9c5b-2022578e7a9e,network=Network(92fc7073-a06d-44ea-bb1b-c86ace99eec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa855e-49') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG os_vif [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=f0fa855e-494f-4fb7-9c5b-2022578e7a9e,network=Network(92fc7073-a06d-44ea-bb1b-c86ace99eec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa855e-49') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98937adf-eb76-5d4f-b4e8-22c20ad262bf', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Instance spawned successfully.
Nov 14 02:06:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0fa855e-49, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0fa855e-49, col_values=(('qos', UUID('8bb9d8f5-d447-4cbb-a258-37d4a26d9872')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0fa855e-49, col_values=(('external_ids', {'iface-id': 'f0fa855e-494f-4fb7-9c5b-2022578e7a9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:65:b2', 'vm-uuid': '8de0ee5b-852a-4146-ba87-378181e1cfc4'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:29 user nova-compute[75257]: INFO os_vif [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=f0fa855e-494f-4fb7-9c5b-2022578e7a9e,network=Network(92fc7073-a06d-44ea-bb1b-c86ace99eec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa855e-49')
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] No VIF found with MAC fa:16:3e:94:45:07, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] No BDM found with device name hda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] No VIF found with MAC fa:16:3e:a2:65:b2, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Using config drive
Nov 14 02:06:29 user nova-compute[75257]: INFO nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Took 13.88 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Updated VIF entry in instance network info cache for port fb5f3206-b474-4ff1-b22a-ec6169264796. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Updating instance_info_cache with network_info: [{"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ac41e7c3-8b0a-455a-afe6-df69cb4065d5 req-c8bb4d62-1c2e-47ac-bad0-cd46c9381031 service nova] Releasing lock "refresh_cache-a1326183-c4cb-40fa-a352-470e2c69cb05" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:06:29 user nova-compute[75257]: INFO nova.compute.manager [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Took 19.18 seconds to build instance.
Nov 14 02:06:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.347s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received event network-vif-plugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] No waiting events found dispatching network-vif-plugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:29 user nova-compute[75257]: WARNING nova.compute.manager [req-d0630f5c-2bfa-4677-aed8-e5887bfa07e9 req-1cb6f4e9-ac89-40a0-afac-a23449541200 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received unexpected event network-vif-plugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance with vm_state building and task_state spawning.
Nov 14 02:06:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2f527fd7-740b-44b2-a37f-5ee536392f23 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.397s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.network.neutron [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:06:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:06:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Creating config drive at /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.config
Nov 14 02:06:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdwoywak7 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:06:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdwoywak7" returned: 0 in 0.123s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:30 user nova-compute[75257]: DEBUG nova.policy [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67156afa3d24427e90e99f944362ecfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91262b32dbc949beb98767d004ff9a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:06:30 user nova-compute[75257]: INFO nova.virt.block_device [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Booting with volume 63a8b1e6-4579-48f6-8a4c-b75386826ce7 at /dev/vda
Nov 14 02:06:30 user nova-compute[75257]: DEBUG nova.network.neutron [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updated VIF entry in instance network info cache for port f0fa855e-494f-4fb7-9c5b-2022578e7a9e. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:30 user nova-compute[75257]: DEBUG nova.network.neutron [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updating instance_info_cache with network_info: [{"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:30 user nova-compute[75257]: DEBUG os_brick.utils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:06:30 user nova-compute[75257]: INFO oslo.privsep.daemon [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmprbb_n3pz/privsep.sock']
Nov 14 02:06:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-05ae393b-a64e-491c-8f71-4da4ca846ff7 req-37322c70-ede2-4ba2-9f59-fbcddf88c1cb service nova] Releasing lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:30 user sudo[85684]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmprbb_n3pz/privsep.sock
Nov 14 02:06:30 user sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 02:06:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:31 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Instance spawned successfully.
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Successfully created port: 7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:06:31 user nova-compute[75257]: INFO nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Took 15.34 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received event network-vif-plugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] No waiting events found dispatching network-vif-plugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:31 user nova-compute[75257]: WARNING nova.compute.manager [req-082e7bda-8a29-4c8c-aaa2-db98df9950e8 req-186f2117-a948-4bf9-a21c-2ceb501536da service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received unexpected event network-vif-plugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance with vm_state building and task_state spawning.
Nov 14 02:06:31 user nova-compute[75257]: INFO nova.compute.manager [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Took 19.44 seconds to build instance.
Nov 14 02:06:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b579c78a-216d-4814-8296-0b84cf4f4abb tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.587s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received event network-vif-plugged-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] No waiting events found dispatching network-vif-plugged-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:32 user nova-compute[75257]: WARNING nova.compute.manager [req-47e61603-5d98-4a11-87f2-630658e9eb22 req-8878f2bf-7db0-40dd-93b0-a09d7c04275a service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received unexpected event network-vif-plugged-fb5f3206-b474-4ff1-b22a-ec6169264796 for instance with vm_state building and task_state spawning.
Nov 14 02:06:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:33 user sudo[85684]: pam_unix(sudo:session): session closed for user root
Nov 14 02:06:33 user nova-compute[75257]: INFO oslo.privsep.daemon [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Spawned new privsep daemon via rootwrap
Nov 14 02:06:33 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 02:06:33 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 02:06:33 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 02:06:33 user nova-compute[75257]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85764
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[62213bff-12a6-4d37-930b-5929256fadbb]: (2,) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG nova.network.neutron [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Successfully updated port: 7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "refresh_cache-42d01836-ef5a-4dba-ab6a-49bfe7976879" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquired lock "refresh_cache-42d01836-ef5a-4dba-ab6a-49bfe7976879" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG nova.network.neutron [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.042s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16e31af-3832-4859-82d4-13ffc003194d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:33 user nova-compute[75257]: WARNING os_brick.initiator.connectors.nvmeof [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.049s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[21510a79-b95a-4b07-b3eb-3138b439d162]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG nova.network.neutron [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.047s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8f16a8-993c-4c90-8fb7-500e364f98e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dec8e3-f2f0-4c0f-a6a5-c176e84b85df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:06:33 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:06:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cf751e-790c-4b8d-bbf6-fc1175270599]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG os_brick.utils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] <== get_connector_properties: return (3113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Updating existing volume attachment record: 8f79cdb5-1451-4bc6-8926-2829bc29b8ce {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:06:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received event network-vif-plugged-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] No waiting events found dispatching network-vif-plugged-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:34 user nova-compute[75257]: WARNING nova.compute.manager [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received unexpected event network-vif-plugged-fb5f3206-b474-4ff1-b22a-ec6169264796 for instance with vm_state building and task_state spawning.
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-changed-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Refreshing instance network info cache due to event network-changed-7c8790c5-8202-4e02-94e3-3581d766cc78. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Acquiring lock "refresh_cache-42d01836-ef5a-4dba-ab6a-49bfe7976879" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.network.neutron [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Updating instance_info_cache with network_info: [{"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:34 user nova-compute[75257]: WARNING nova.compute.manager [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance with vm_state building and task_state spawning.
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:34 user nova-compute[75257]: WARNING nova.compute.manager [req-32aae37f-6523-4847-ad32-faae77b9448c req-251203dc-7768-46c5-b17a-454e91477ca2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance with vm_state building and task_state spawning.
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Releasing lock "refresh_cache-42d01836-ef5a-4dba-ab6a-49bfe7976879" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance network_info: |[{"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Acquired lock "refresh_cache-42d01836-ef5a-4dba-ab6a-49bfe7976879" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:34 user nova-compute[75257]: DEBUG nova.network.neutron [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Refreshing network info cache for port 7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:06:35 user nova-compute[75257]: DEBUG nova.network.neutron [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Updated VIF entry in instance network info cache for port 7c8790c5-8202-4e02-94e3-3581d766cc78. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:06:35 user nova-compute[75257]: DEBUG nova.network.neutron [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Updating instance_info_cache with network_info: [{"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-71f20728-f317-48fe-ad7f-f96364e21b02 req-7c577c24-2390-4119-b46d-51b363473e30 service nova] Releasing lock "refresh_cache-42d01836-ef5a-4dba-ab6a-49bfe7976879" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Instance spawned successfully.
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:36 user nova-compute[75257]: INFO nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Took 11.55 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Instance spawned successfully.
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:36 user nova-compute[75257]: INFO nova.compute.manager [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Took 13.44 seconds to build instance.
Nov 14 02:06:36 user nova-compute[75257]: INFO nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Took 15.44 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-33d86bd4-2e5e-49d4-a035-8df748278d1e tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.011s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:36 user nova-compute[75257]: INFO nova.compute.manager [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Took 18.06 seconds to build instance.
Nov 14 02:06:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dad9e398-4392-4671-8c49-f8555657dece tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.391s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:06:40 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Creating image(s)
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Ensure instance console log exists: /opt/stack/data/nova/instances/42d01836-ef5a-4dba-ab6a-49bfe7976879/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Start _get_guest_xml network_info=[{"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8f79cdb5-1451-4bc6-8926-2829bc29b8ce', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNrvPjld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42d01836-ef5a-4dba-ab6a-49bfe7976879', 'attached_at': '', 'detached_at': '', 'volume_id': '63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'serial': '63a8b1e6-4579-48f6-8a4c-b75386826ce7'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:06:40 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:40 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connector [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Factory for ISCSI on None {{(pid=75257) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNrvPjld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:06:40 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:06:40 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:06:40 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[859e56e2-62f7-423c-8793-83ac286fdee5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:06:40 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8edfbed-e173-459c-b197-722eea77fe8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7] added
Nov 14 02:06:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76feca8-0a3e-43ae-88c4-cdb6c09c31e7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fc7190-80b2-46d9-8c2e-cbdd2912e515]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNrvPjld {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNrvPjld" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b9f99-9e1c-454f-b87b-f24d03c40193]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNrvPjld'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78ff4ac-492f-47f9-a519-b616be39127e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3e6156-9279-49e2-998d-2055852d553c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:06:40 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:06:40 user nova-compute[75257]:  {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:06:40 user nova-compute[75257]: WARNING os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 02:06:40 user nova-compute[75257]: 
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[915db972-43bc-44aa-9b29-561b2c9013b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260]
Nov 14 02:06:40 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260] successful.
Nov 14 02:06:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba431f5c-5a47-4609-a8cf-78dddd917429]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2918cb1-7343-4157-8f7f-bb3cc0e36670]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:06:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:06:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f61bd-f772-4df4-b4cc-fe3505e0b907]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:06:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNrvPjld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23664373836643738', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664373836643738', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-830117018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-830117018',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgf2fXbCY9rsjb34KMUST8SMXto50nACORXEnnMj+K0J2fgBaFnj6x23XOrkc5PvkSbOH/DwnZ6aLyMOr4VrPPGI6VOba5H/JsmvGMycdDB8yWuFuzI/QXeNX4GuWC8IA==',key_name='tempest-keypair-586767792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91262b32dbc949beb98767d004ff9a73',ramdisk_id='',reservation_id='r-mljiki2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-358377017',owner_user_name='tempest-ServerActionsV293TestJSON-358377017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67156afa3d24427e90e99f944362ecfe',uuid=42d01836-ef5a-4dba-ab6a-49bfe7976879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converting VIF {"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lazy-loading 'pci_devices' on Instance uuid 42d01836-ef5a-4dba-ab6a-49bfe7976879 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:06:41 user nova-compute[75257]:   <uuid>42d01836-ef5a-4dba-ab6a-49bfe7976879</uuid>
Nov 14 02:06:41 user nova-compute[75257]:   <name>instance-0000000a</name>
Nov 14 02:06:41 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:06:41 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:06:41 user nova-compute[75257]:   <metadata>
Nov 14 02:06:41 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:06:41 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:06:41 user nova-compute[75257]:       <nova:name>tempest-ServerActionsV293TestJSON-server-830117018</nova:name>
Nov 14 02:06:41 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:06:40</nova:creationTime>
Nov 14 02:06:41 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:06:41 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:06:41 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:06:41 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:06:41 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:06:41 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:06:41 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:06:41 user nova-compute[75257]:       <nova:owner>
Nov 14 02:06:41 user nova-compute[75257]:         <nova:user uuid="67156afa3d24427e90e99f944362ecfe">tempest-ServerActionsV293TestJSON-358377017-project-member</nova:user>
Nov 14 02:06:41 user nova-compute[75257]:         <nova:project uuid="91262b32dbc949beb98767d004ff9a73">tempest-ServerActionsV293TestJSON-358377017</nova:project>
Nov 14 02:06:41 user nova-compute[75257]:       </nova:owner>
Nov 14 02:06:41 user nova-compute[75257]:       <nova:ports>
Nov 14 02:06:41 user nova-compute[75257]:         <nova:port uuid="7c8790c5-8202-4e02-94e3-3581d766cc78">
Nov 14 02:06:41 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 02:06:41 user nova-compute[75257]:         </nova:port>
Nov 14 02:06:41 user nova-compute[75257]:       </nova:ports>
Nov 14 02:06:41 user nova-compute[75257]:     </nova:instance>
Nov 14 02:06:41 user nova-compute[75257]:   </metadata>
Nov 14 02:06:41 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:06:41 user nova-compute[75257]:     <system>
Nov 14 02:06:41 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:06:41 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:06:41 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:06:41 user nova-compute[75257]:       <entry name="serial">42d01836-ef5a-4dba-ab6a-49bfe7976879</entry>
Nov 14 02:06:41 user nova-compute[75257]:       <entry name="uuid">42d01836-ef5a-4dba-ab6a-49bfe7976879</entry>
Nov 14 02:06:41 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:06:41 user nova-compute[75257]:     </system>
Nov 14 02:06:41 user nova-compute[75257]:   </sysinfo>
Nov 14 02:06:41 user nova-compute[75257]:   <os>
Nov 14 02:06:41 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:06:41 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:06:41 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:06:41 user nova-compute[75257]:   </os>
Nov 14 02:06:41 user nova-compute[75257]:   <features>
Nov 14 02:06:41 user nova-compute[75257]:     <acpi/>
Nov 14 02:06:41 user nova-compute[75257]:     <apic/>
Nov 14 02:06:41 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:06:41 user nova-compute[75257]:   </features>
Nov 14 02:06:41 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:06:41 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:06:41 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:06:41 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:06:41 user nova-compute[75257]:   </clock>
Nov 14 02:06:41 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:06:41 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:06:41 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:06:41 user nova-compute[75257]:   </cpu>
Nov 14 02:06:41 user nova-compute[75257]:   <devices>
Nov 14 02:06:41 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:06:41 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:06:41 user nova-compute[75257]:       <source dev="/dev/sdb"/>
Nov 14 02:06:41 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:06:41 user nova-compute[75257]:       <serial>63a8b1e6-4579-48f6-8a4c-b75386826ce7</serial>
Nov 14 02:06:41 user nova-compute[75257]:     </disk>
Nov 14 02:06:41 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:06:41 user nova-compute[75257]:       <mac address="fa:16:3e:b4:04:3c"/>
Nov 14 02:06:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:41 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:06:41 user nova-compute[75257]:       <target dev="tap7c8790c5-82"/>
Nov 14 02:06:41 user nova-compute[75257]:     </interface>
Nov 14 02:06:41 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:06:41 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/42d01836-ef5a-4dba-ab6a-49bfe7976879/console.log" append="off"/>
Nov 14 02:06:41 user nova-compute[75257]:     </serial>
Nov 14 02:06:41 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:06:41 user nova-compute[75257]:     <video>
Nov 14 02:06:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:06:41 user nova-compute[75257]:     </video>
Nov 14 02:06:41 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:06:41 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:06:41 user nova-compute[75257]:     </rng>
Nov 14 02:06:41 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:06:41 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:06:41 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:06:41 user nova-compute[75257]:     </memballoon>
Nov 14 02:06:41 user nova-compute[75257]:   </devices>
Nov 14 02:06:41 user nova-compute[75257]: </domain>
Nov 14 02:06:41 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-830117018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-830117018',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgf2fXbCY9rsjb34KMUST8SMXto50nACORXEnnMj+K0J2fgBaFnj6x23XOrkc5PvkSbOH/DwnZ6aLyMOr4VrPPGI6VOba5H/JsmvGMycdDB8yWuFuzI/QXeNX4GuWC8IA==',key_name='tempest-keypair-586767792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91262b32dbc949beb98767d004ff9a73',ramdisk_id='',reservation_id='r-mljiki2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-358377017',owner_user_name='tempest-ServerActionsV293TestJSON-358377017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67156afa3d24427e90e99f944362ecfe',uuid=42d01836-ef5a-4dba-ab6a-49bfe7976879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converting VIF {"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG os_vif [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a1b59c1-e2fb-5c3c-b94e-343e4d8d5574', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c8790c5-82, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c8790c5-82, col_values=(('qos', UUID('5f23e33e-5491-4e11-9e99-613d3c5a1b43')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c8790c5-82, col_values=(('external_ids', {'iface-id': '7c8790c5-8202-4e02-94e3-3581d766cc78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:04:3c', 'vm-uuid': '42d01836-ef5a-4dba-ab6a-49bfe7976879'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:41 user nova-compute[75257]: INFO os_vif [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82')
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:06:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] No VIF found with MAC fa:16:3e:b4:04:3c, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:06:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] No waiting events found dispatching network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:43 user nova-compute[75257]: WARNING nova.compute.manager [req-7861d196-1425-4e31-8a63-886bbfcfaa24 req-dcb5c80e-bf6c-4dfa-bbca-e2db5d3164ad service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received unexpected event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 for instance with vm_state building and task_state spawning.
Nov 14 02:06:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:06:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:06:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:06:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] No waiting events found dispatching network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:46 user nova-compute[75257]: WARNING nova.compute.manager [req-2f854c14-b75c-4b25-b678-e684ac833450 req-c807382a-e0b1-4108-9fc2-9e1a91284533 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received unexpected event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 for instance with vm_state building and task_state spawning.
Nov 14 02:06:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:06:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance spawned successfully.
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:06:47 user nova-compute[75257]: INFO nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 14 02:06:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:06:47 user nova-compute[75257]: INFO nova.compute.manager [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Took 18.99 seconds to build instance.
Nov 14 02:06:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a574ec61-e00d-4944-80b5-43fbf1d6a7e6 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.165s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:47 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:47 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:06:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:06:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:06:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:06:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:06:47 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Updating instance_info_cache with network_info: [{"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG nova.compute.manager [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received event network-vif-plugged-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] Acquiring lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:48 user nova-compute[75257]: DEBUG nova.compute.manager [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] No waiting events found dispatching network-vif-plugged-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:48 user nova-compute[75257]: WARNING nova.compute.manager [req-8dd5034b-279d-414d-88ba-29c02147affc req-0ffdc1b2-df6d-46c0-b1b9-e4071f316aee service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received unexpected event network-vif-plugged-592113b0-b777-4a01-ac6c-d5337e7d773a for instance with vm_state active and task_state None.
Nov 14 02:06:49 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:06:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:49 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:06:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received event network-vif-plugged-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] Acquiring lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] No waiting events found dispatching network-vif-plugged-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:06:51 user nova-compute[75257]: WARNING nova.compute.manager [req-c78932c6-eab8-4a7c-bbc0-fb6da5ec8b22 req-18f103d2-1886-4595-a007-28a43afa0941 service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received unexpected event network-vif-plugged-592113b0-b777-4a01-ac6c-d5337e7d773a for instance with vm_state active and task_state None.
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:06:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:06:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7138MB free_disk=25.608654022216797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 71a9d20f-e79b-4716-abf8-a15330742167 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2f9df98c-7814-419d-8821-d8c571972f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance fd62b270-19d7-45e5-bd66-a94c384050bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a1326183-c4cb-40fa-a352-470e2c69cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:06:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:06:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:06:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:07:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:07:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:07:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:07:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:07:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:07:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:07:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:07:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:07:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:07:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-changed-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Refreshing instance network info cache due to event network-changed-cc019053-7c21-4e5c-981e-389fe4a4beed. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] Acquiring lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] Acquired lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG nova.network.neutron [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Refreshing network info cache for port cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "b950c25e-2910-4de3-a9fc-30e4091dfe19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:07:47 user nova-compute[75257]: INFO nova.compute.claims [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Claim successful on node user
Nov 14 02:07:47 user nova-compute[75257]: DEBUG nova.objects.instance [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lazy-loading 'flavor' on Instance uuid 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:07:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.152s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:48 user nova-compute[75257]: INFO nova.compute.manager [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Attaching volume 67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 to /dev/vdb
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.compute.manager [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-changed-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.compute.manager [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Refreshing instance network info cache due to event network-changed-8fe0bc37-945a-433d-8dd0-43514dce6f99. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] Acquiring lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] Acquired lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.network.neutron [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Refreshing network info cache for port 8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG os_brick.utils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd5d40-d618-4e03-af7e-791dca0e837e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[df32e71f-d9e8-432e-9f5e-2fd2de22a25a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3403f6-4618-4e23-863b-3df050e5cc0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[522bbcf8-8597-4906-ab1b-71f48525c8c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.network.neutron [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:07:48 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[05048384-0e90-4602-83e8-6587a3426d2e]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG os_brick.utils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Updating existing volume attachment record: 1fc39696-120b-4c8b-ac21-3c9561ed49c3 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:07:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:07:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Creating image(s)
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "/opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "/opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "/opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.policy [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bf2a54e5cb84e16b3218e3ca1f2fbdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2958ade8524b6e9c245384d7fe9b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.209s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.network.neutron [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updated VIF entry in instance network info cache for port cc019053-7c21-4e5c-981e-389fe4a4beed. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG nova.network.neutron [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updating instance_info_cache with network_info: [{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6fd3cddd-85dc-498e-8c06-37383df7df2d req-71f55480-e9da-4a82-9859-0757f8029614 service nova] Releasing lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk 1073741824" returned: 0 in 0.201s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.400s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.network.neutron [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updated VIF entry in instance network info cache for port 8fe0bc37-945a-433d-8dd0-43514dce6f99. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.network.neutron [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8d41d27a-9d0c-4684-a79f-64c8cf10e4b2 req-78bcce99-7d47-4009-b8e4-3aacca250333 service nova] Releasing lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Successfully created port: 3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.objects.instance [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Cannot resize image /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Ensure instance console log exists: /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received event network-changed-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Refreshing instance network info cache due to event network-changed-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] Acquiring lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] Acquired lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG nova.network.neutron [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Refreshing network info cache for port 305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:07:49 user nova-compute[75257]: INFO nova.compute.manager [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] instance snapshotting
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Beginning live snapshot process
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:49 user nova-compute[75257]: INFO nova.compute.manager [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Attaching volume 399fd6d1-cc6f-432c-96c2-eb97da1c0ceb to /dev/vdb
Nov 14 02:07:49 user nova-compute[75257]: DEBUG os_brick.utils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c74b0c0-e786-421e-b306-00c3266e8834]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1ff579-ac0d-4e04-b216-f825000e41f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json -f qcow2 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7311acf-be8c-4dc7-b39c-043356e7ebfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[291fb164-57f4-41cf-887f-dd6177aff413]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:07:50 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56a57b7-03a2-46e4-b976-af769d6e9da2]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG os_brick.utils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updating existing volume attachment record: c1bd7d32-7ca7-4e43-902f-aea0c3445d93 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json -f qcow2 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Successfully updated port: 3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "refresh_cache-b950c25e-2910-4de3-a9fc-30e4091dfe19" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquired lock "refresh_cache-b950c25e-2910-4de3-a9fc-30e4091dfe19" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updated VIF entry in instance network info cache for port 305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updating instance_info_cache with network_info: [{"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received event network-changed-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Refreshing instance network info cache due to event network-changed-3ec017bb-c846-419e-a33f-860b071d3b18. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] Acquiring lock "refresh_cache-b950c25e-2910-4de3-a9fc-30e4091dfe19" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:07:50 user nova-compute[75257]: INFO nova.compute.claims [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Claim successful on node user
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8c4a733f-d0c3-4c85-a7a6-09a418e28bae req-4bb15f27-9404-40ad-a7db-3338d706687a service nova] Releasing lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.199s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt7utlcu3/d18ba77c7c4c4fa2ac0036e7294f1054.delta 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt7utlcu3/d18ba77c7c4c4fa2ac0036e7294f1054.delta 1073741824" returned: 0 in 0.056s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:50 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75257) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 02:07:50 user nova-compute[75257]: INFO nova.virt.libvirt.host [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] UEFI support detected
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Updating instance_info_cache with network_info: [{"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Releasing lock "refresh_cache-b950c25e-2910-4de3-a9fc-30e4091dfe19" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Instance network_info: |[{"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] Acquired lock "refresh_cache-b950c25e-2910-4de3-a9fc-30e4091dfe19" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Refreshing network info cache for port 3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Start _get_guest_xml network_info=[{"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:07:50 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:07:50 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1101070144',display_name='tempest-ServersNegativeTestJSON-server-1101070144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1101070144',id=11,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df2958ade8524b6e9c245384d7fe9b92',ramdisk_id='',reservation_id='r-i35kv15h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1705676333',owner_user_name='tempest-ServersNegativeTestJSON-1705676333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:07:48Z,user_data=None,user_id='1bf2a54e5cb84e16b3218e3ca1f2fbdc',uuid=b950c25e-2910-4de3-a9fc-30e4091dfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converting VIF {"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1f:f8,bridge_name='br-int',has_traffic_filtering=True,id=3ec017bb-c846-419e-a33f-860b071d3b18,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec017bb-c8') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.objects.instance [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lazy-loading 'pci_devices' on Instance uuid b950c25e-2910-4de3-a9fc-30e4091dfe19 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:07:50 user nova-compute[75257]:   <uuid>b950c25e-2910-4de3-a9fc-30e4091dfe19</uuid>
Nov 14 02:07:50 user nova-compute[75257]:   <name>instance-0000000b</name>
Nov 14 02:07:50 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:07:50 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:07:50 user nova-compute[75257]:   <metadata>
Nov 14 02:07:50 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:07:50 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:07:50 user nova-compute[75257]:       <nova:name>tempest-ServersNegativeTestJSON-server-1101070144</nova:name>
Nov 14 02:07:50 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:07:50</nova:creationTime>
Nov 14 02:07:50 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:07:50 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:07:50 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:07:50 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:07:50 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:07:50 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:07:50 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:07:50 user nova-compute[75257]:       <nova:owner>
Nov 14 02:07:50 user nova-compute[75257]:         <nova:user uuid="1bf2a54e5cb84e16b3218e3ca1f2fbdc">tempest-ServersNegativeTestJSON-1705676333-project-member</nova:user>
Nov 14 02:07:50 user nova-compute[75257]:         <nova:project uuid="df2958ade8524b6e9c245384d7fe9b92">tempest-ServersNegativeTestJSON-1705676333</nova:project>
Nov 14 02:07:50 user nova-compute[75257]:       </nova:owner>
Nov 14 02:07:50 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:07:50 user nova-compute[75257]:       <nova:ports>
Nov 14 02:07:50 user nova-compute[75257]:         <nova:port uuid="3ec017bb-c846-419e-a33f-860b071d3b18">
Nov 14 02:07:50 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 02:07:50 user nova-compute[75257]:         </nova:port>
Nov 14 02:07:50 user nova-compute[75257]:       </nova:ports>
Nov 14 02:07:50 user nova-compute[75257]:     </nova:instance>
Nov 14 02:07:50 user nova-compute[75257]:   </metadata>
Nov 14 02:07:50 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:07:50 user nova-compute[75257]:     <system>
Nov 14 02:07:50 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:07:50 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:07:50 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:07:50 user nova-compute[75257]:       <entry name="serial">b950c25e-2910-4de3-a9fc-30e4091dfe19</entry>
Nov 14 02:07:50 user nova-compute[75257]:       <entry name="uuid">b950c25e-2910-4de3-a9fc-30e4091dfe19</entry>
Nov 14 02:07:50 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:07:50 user nova-compute[75257]:     </system>
Nov 14 02:07:50 user nova-compute[75257]:   </sysinfo>
Nov 14 02:07:50 user nova-compute[75257]:   <os>
Nov 14 02:07:50 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:07:50 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:07:50 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:07:50 user nova-compute[75257]:   </os>
Nov 14 02:07:50 user nova-compute[75257]:   <features>
Nov 14 02:07:50 user nova-compute[75257]:     <acpi/>
Nov 14 02:07:50 user nova-compute[75257]:     <apic/>
Nov 14 02:07:50 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:07:50 user nova-compute[75257]:   </features>
Nov 14 02:07:50 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:07:50 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:07:50 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:07:50 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:07:50 user nova-compute[75257]:   </clock>
Nov 14 02:07:50 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:07:50 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:07:50 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:07:50 user nova-compute[75257]:   </cpu>
Nov 14 02:07:50 user nova-compute[75257]:   <devices>
Nov 14 02:07:50 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:07:50 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:07:50 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk"/>
Nov 14 02:07:50 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:07:50 user nova-compute[75257]:     </disk>
Nov 14 02:07:50 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:07:50 user nova-compute[75257]:       <mac address="fa:16:3e:8d:1f:f8"/>
Nov 14 02:07:50 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:07:50 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:07:50 user nova-compute[75257]:       <target dev="tap3ec017bb-c8"/>
Nov 14 02:07:50 user nova-compute[75257]:     </interface>
Nov 14 02:07:50 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:07:50 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/console.log" append="off"/>
Nov 14 02:07:50 user nova-compute[75257]:     </serial>
Nov 14 02:07:50 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:07:50 user nova-compute[75257]:     <video>
Nov 14 02:07:50 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:07:50 user nova-compute[75257]:     </video>
Nov 14 02:07:50 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:07:50 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:07:50 user nova-compute[75257]:     </rng>
Nov 14 02:07:50 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:07:50 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:07:50 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:07:50 user nova-compute[75257]:     </memballoon>
Nov 14 02:07:50 user nova-compute[75257]:   </devices>
Nov 14 02:07:50 user nova-compute[75257]: </domain>
Nov 14 02:07:50 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1101070144',display_name='tempest-ServersNegativeTestJSON-server-1101070144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1101070144',id=11,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df2958ade8524b6e9c245384d7fe9b92',ramdisk_id='',reservation_id='r-i35kv15h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1705676333',owner_user_name='tempest-ServersNegativeTestJSON-1705676333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:07:48Z,user_data=None,user_id='1bf2a54e5cb84e16b3218e3ca1f2fbdc',uuid=b950c25e-2910-4de3-a9fc-30e4091dfe19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converting VIF {"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1f:f8,bridge_name='br-int',has_traffic_filtering=True,id=3ec017bb-c846-419e-a33f-860b071d3b18,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec017bb-c8') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG os_vif [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1f:f8,bridge_name='br-int',has_traffic_filtering=True,id=3ec017bb-c846-419e-a33f-860b071d3b18,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec017bb-c8') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57482ef6-dea1-5c5c-a780-441b9a57b1c8', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ec017bb-c8, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ec017bb-c8, col_values=(('qos', UUID('fbbd5931-fc01-42d5-ae26-0a627ef31b1d')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ec017bb-c8, col_values=(('external_ids', {'iface-id': '3ec017bb-c846-419e-a33f-860b071d3b18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:1f:f8', 'vm-uuid': 'b950c25e-2910-4de3-a9fc-30e4091dfe19'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:07:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:50 user nova-compute[75257]: INFO os_vif [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1f:f8,bridge_name='br-int',has_traffic_filtering=True,id=3ec017bb-c846-419e-a33f-860b071d3b18,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec017bb-c8')
Nov 14 02:07:50 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] No VIF found with MAC fa:16:3e:8d:1f:f8, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.network.neutron [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:07:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:07:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Creating image(s)
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "/opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "/opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.policy [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83c1fd3efa9a4997be00910265484154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b17ddccd4d7d82adbc420ad6adc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Updated VIF entry in instance network info cache for port 3ec017bb-c846-419e-a33f-860b071d3b18. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Updating instance_info_cache with network_info: [{"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-422b1310-9aa8-4fc7-bbbc-b71ee0137651 req-0bccd130-b057-467c-b92b-9a2cc5031d02 service nova] Releasing lock "refresh_cache-b950c25e-2910-4de3-a9fc-30e4091dfe19" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.426s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:07:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.203s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk 1073741824" returned: 0 in 0.056s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt7utlcu3/d18ba77c7c4c4fa2ac0036e7294f1054.delta /opt/stack/data/nova/instances/snapshots/tmpt7utlcu3/d18ba77c7c4c4fa2ac0036e7294f1054 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.168s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG nova.network.neutron [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Successfully created port: 7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Cannot resize image /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Ensure instance console log exists: /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt7utlcu3/d18ba77c7c4c4fa2ac0036e7294f1054.delta /opt/stack/data/nova/instances/snapshots/tmpt7utlcu3/d18ba77c7c4c4fa2ac0036e7294f1054" returned: 0 in 0.910s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:52 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Snapshot extracted, beginning image upload
Nov 14 02:07:52 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received event network-vif-plugged-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] Acquiring lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] No waiting events found dispatching network-vif-plugged-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:07:53 user nova-compute[75257]: WARNING nova.compute.manager [req-ba20414f-e4a1-4460-8895-be76694d745d req-219ac9a4-3ad9-453a-96bd-7475fd3e16d6 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received unexpected event network-vif-plugged-3ec017bb-c846-419e-a33f-860b071d3b18 for instance with vm_state building and task_state spawning.
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEAwkWay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:07:53 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:07:53 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:07:53 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f88a629-76b3-4c95-be9d-751f345b5df3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:07:53 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c383d065-e977-4b42-959d-287fd02fc20f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3] added
Nov 14 02:07:53 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda8f46f-07eb-4dd7-92db-18bb08e1d83b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88a3082-7266-4f64-9932-e573f2c261e9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG nova.network.neutron [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Successfully updated port: 7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OEAwkWay {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "refresh_cache-1a6df88a-5599-4b10-917c-c3c0b009c3cb" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquired lock "refresh_cache-1a6df88a-5599-4b10-917c-c3c0b009c3cb" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG nova.network.neutron [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OEAwkWay" returned: 0 in 0.034s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[76683101-6b2d-4052-b7b1-5bb46307c5e1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OEAwkWay'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3525704d-fc47-44b4-a1f0-a528c15350fa]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3820f8-775d-470f-bacb-5c72272ae879]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:53 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:53 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG nova.network.neutron [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a78ff2-82ad-4f0c-8f84-c38b65136b69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3, portal: 172.16.0.220,3260]
Nov 14 02:07:53 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3, portal: 172.16.0.220,3260] successful.
Nov 14 02:07:53 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9688835-9fe9-417b-afee-998678997e33]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d223b85-acb0-4a74-af53-228fbc4f8d9e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:53 user nova-compute[75257]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)
Nov 14 02:07:53 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:53 user nova-compute[75257]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)
Nov 14 02:07:53 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f643f0-5857-4ce7-a121-323964206840]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEAwkWay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:07:53 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updating instance_info_cache with network_info: [{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.network.neutron [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Updating instance_info_cache with network_info: [{"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Releasing lock "refresh_cache-1a6df88a-5599-4b10-917c-c3c0b009c3cb" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Instance network_info: |[{"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Start _get_guest_xml network_info=[{"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:07:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:07:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2071366743',display_name='tempest-TestServerVolumeAttachmentScenario-server-2071366743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2071366743',id=12,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLTqWumKP5WLuDxvDcPlc4017G4UnwfFpm58ymfDNqIIv4mmT7uWp6VUwoXAw4ASrN05TZ0JaBF1S4zNfqxHQpdOoaI/VdjQ0yhIPt3PxWX2JXh2URVHKy0oiWfxltLOA==',key_name='tempest-keypair-309882152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5778b17ddccd4d7d82adbc420ad6adc0',ramdisk_id='',reservation_id='r-b1bkxfty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-76705494',owner_user_name='tempest-TestServerVolumeAttachmentScenario-76705494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83c1fd3efa9a4997be00910265484154',uuid=1a6df88a-5599-4b10-917c-c3c0b009c3cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Converting VIF {"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:65,bridge_name='br-int',has_traffic_filtering=True,id=7946fb64-2722-4b7d-a7bc-5223ad6536e5,network=Network(ccc94fe2-6b16-46cd-8221-521a9b2cf069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7946fb64-27') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:07:54 user nova-compute[75257]:   <uuid>1a6df88a-5599-4b10-917c-c3c0b009c3cb</uuid>
Nov 14 02:07:54 user nova-compute[75257]:   <name>instance-0000000c</name>
Nov 14 02:07:54 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:07:54 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:07:54 user nova-compute[75257]:   <metadata>
Nov 14 02:07:54 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:07:54 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:07:54 user nova-compute[75257]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2071366743</nova:name>
Nov 14 02:07:54 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:07:54</nova:creationTime>
Nov 14 02:07:54 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:07:54 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:07:54 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:07:54 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:07:54 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:07:54 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:07:54 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:07:54 user nova-compute[75257]:       <nova:owner>
Nov 14 02:07:54 user nova-compute[75257]:         <nova:user uuid="83c1fd3efa9a4997be00910265484154">tempest-TestServerVolumeAttachmentScenario-76705494-project-member</nova:user>
Nov 14 02:07:54 user nova-compute[75257]:         <nova:project uuid="5778b17ddccd4d7d82adbc420ad6adc0">tempest-TestServerVolumeAttachmentScenario-76705494</nova:project>
Nov 14 02:07:54 user nova-compute[75257]:       </nova:owner>
Nov 14 02:07:54 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:07:54 user nova-compute[75257]:       <nova:ports>
Nov 14 02:07:54 user nova-compute[75257]:         <nova:port uuid="7946fb64-2722-4b7d-a7bc-5223ad6536e5">
Nov 14 02:07:54 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 02:07:54 user nova-compute[75257]:         </nova:port>
Nov 14 02:07:54 user nova-compute[75257]:       </nova:ports>
Nov 14 02:07:54 user nova-compute[75257]:     </nova:instance>
Nov 14 02:07:54 user nova-compute[75257]:   </metadata>
Nov 14 02:07:54 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:07:54 user nova-compute[75257]:     <system>
Nov 14 02:07:54 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:07:54 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:07:54 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:07:54 user nova-compute[75257]:       <entry name="serial">1a6df88a-5599-4b10-917c-c3c0b009c3cb</entry>
Nov 14 02:07:54 user nova-compute[75257]:       <entry name="uuid">1a6df88a-5599-4b10-917c-c3c0b009c3cb</entry>
Nov 14 02:07:54 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:07:54 user nova-compute[75257]:     </system>
Nov 14 02:07:54 user nova-compute[75257]:   </sysinfo>
Nov 14 02:07:54 user nova-compute[75257]:   <os>
Nov 14 02:07:54 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:07:54 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:07:54 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:07:54 user nova-compute[75257]:   </os>
Nov 14 02:07:54 user nova-compute[75257]:   <features>
Nov 14 02:07:54 user nova-compute[75257]:     <acpi/>
Nov 14 02:07:54 user nova-compute[75257]:     <apic/>
Nov 14 02:07:54 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:07:54 user nova-compute[75257]:   </features>
Nov 14 02:07:54 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:07:54 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:07:54 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:07:54 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:07:54 user nova-compute[75257]:   </clock>
Nov 14 02:07:54 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:07:54 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:07:54 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:07:54 user nova-compute[75257]:   </cpu>
Nov 14 02:07:54 user nova-compute[75257]:   <devices>
Nov 14 02:07:54 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:07:54 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:07:54 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk"/>
Nov 14 02:07:54 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:07:54 user nova-compute[75257]:     </disk>
Nov 14 02:07:54 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:07:54 user nova-compute[75257]:       <mac address="fa:16:3e:55:56:65"/>
Nov 14 02:07:54 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:07:54 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:07:54 user nova-compute[75257]:       <target dev="tap7946fb64-27"/>
Nov 14 02:07:54 user nova-compute[75257]:     </interface>
Nov 14 02:07:54 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:07:54 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/console.log" append="off"/>
Nov 14 02:07:54 user nova-compute[75257]:     </serial>
Nov 14 02:07:54 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:07:54 user nova-compute[75257]:     <video>
Nov 14 02:07:54 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:07:54 user nova-compute[75257]:     </video>
Nov 14 02:07:54 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:07:54 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:07:54 user nova-compute[75257]:     </rng>
Nov 14 02:07:54 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:07:54 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:07:54 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:07:54 user nova-compute[75257]:     </memballoon>
Nov 14 02:07:54 user nova-compute[75257]:   </devices>
Nov 14 02:07:54 user nova-compute[75257]: </domain>
Nov 14 02:07:54 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2071366743',display_name='tempest-TestServerVolumeAttachmentScenario-server-2071366743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2071366743',id=12,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLTqWumKP5WLuDxvDcPlc4017G4UnwfFpm58ymfDNqIIv4mmT7uWp6VUwoXAw4ASrN05TZ0JaBF1S4zNfqxHQpdOoaI/VdjQ0yhIPt3PxWX2JXh2URVHKy0oiWfxltLOA==',key_name='tempest-keypair-309882152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5778b17ddccd4d7d82adbc420ad6adc0',ramdisk_id='',reservation_id='r-b1bkxfty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-76705494',owner_user_name='tempest-TestServerVolumeAttachmentScenario-76705494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83c1fd3efa9a4997be00910265484154',uuid=1a6df88a-5599-4b10-917c-c3c0b009c3cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Converting VIF {"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:65,bridge_name='br-int',has_traffic_filtering=True,id=7946fb64-2722-4b7d-a7bc-5223ad6536e5,network=Network(ccc94fe2-6b16-46cd-8221-521a9b2cf069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7946fb64-27') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_vif [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:65,bridge_name='br-int',has_traffic_filtering=True,id=7946fb64-2722-4b7d-a7bc-5223ad6536e5,network=Network(ccc94fe2-6b16-46cd-8221-521a9b2cf069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7946fb64-27') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '913fab6a-ba6e-5e0f-b9fd-cb6593d447b0', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7946fb64-27, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7946fb64-27, col_values=(('qos', UUID('2931d302-7db0-4f4a-83fc-8abc7682513a')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7946fb64-27, col_values=(('external_ids', {'iface-id': '7946fb64-2722-4b7d-a7bc-5223ad6536e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:56:65', 'vm-uuid': '1a6df88a-5599-4b10-917c-c3c0b009c3cb'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:54 user nova-compute[75257]: INFO os_vif [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:65,bridge_name='br-int',has_traffic_filtering=True,id=7946fb64-2722-4b7d-a7bc-5223ad6536e5,network=Network(ccc94fe2-6b16-46cd-8221-521a9b2cf069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7946fb64-27')
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] No VIF found with MAC fa:16:3e:55:56:65, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26666316439623931', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666316439623931', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lazy-loading 'flavor' on Instance uuid 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:07:54 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:07:54 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:07:54 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:07:54 user nova-compute[75257]:   <serial>67d3d4c4-83a2-43e0-ab0a-b532171bf9c3</serial>
Nov 14 02:07:54 user nova-compute[75257]: </disk>
Nov 14 02:07:54 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDKHQIqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:07:54 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:07:54 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:07:54 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[58efa8f7-30dc-4465-8c80-d75636a9e9e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:07:54 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[662ec3c6-b31d-4ef3-9903-8ae33b8a6457]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb] added
Nov 14 02:07:54 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[be472c86-9930-477b-b5b1-271e976e3b86]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c7d360-c45d-461f-ac6a-30b978c8e97b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDKHQIqE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDKHQIqE" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[422be348-0d28-4f00-a47f-a2b1e8748eb6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kDKHQIqE'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0702cec1-d8d1-4c11-9653-bf0ca90ab710]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9550cee8-c0b8-45f3-8a6a-db0be6a70c7b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:55 user nova-compute[75257]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)
Nov 14 02:07:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:55 user nova-compute[75257]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)
Nov 14 02:07:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e91530-b4db-4bd3-ad42-71bee0f9e424]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260]
Nov 14 02:07:55 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260] successful.
Nov 14 02:07:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received event network-changed-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Refreshing instance network info cache due to event network-changed-7946fb64-2722-4b7d-a7bc-5223ad6536e5. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Acquiring lock "refresh_cache-1a6df88a-5599-4b10-917c-c3c0b009c3cb" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Acquired lock "refresh_cache-1a6df88a-5599-4b10-917c-c3c0b009c3cb" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Refreshing network info cache for port 7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7818a52b-e3bc-4c73-8611-791405df0fcc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[988fb006-1c97-4de2-b9e9-ded86d8b4016]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:55 user nova-compute[75257]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)
Nov 14 02:07:55 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:07:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:55 user nova-compute[75257]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)
Nov 14 02:07:55 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:07:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1237f840-83c1-4895-85a0-c43f36f8cb4e]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDKHQIqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:07:55 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Instance spawned successfully.
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:55 user nova-compute[75257]: INFO nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Took 7.11 seconds to spawn the instance on the hypervisor.
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Updated VIF entry in instance network info cache for port 7946fb64-2722-4b7d-a7bc-5223ad6536e5. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Updating instance_info_cache with network_info: [{"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Releasing lock "refresh_cache-1a6df88a-5599-4b10-917c-c3c0b009c3cb" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received event network-vif-plugged-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Acquiring lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] No waiting events found dispatching network-vif-plugged-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:07:55 user nova-compute[75257]: WARNING nova.compute.manager [req-7eb2fe7d-f49f-4bab-89aa-373cae4a0084 req-548bce32-0caa-4f24-8b8f-cf367670c8b4 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received unexpected event network-vif-plugged-3ec017bb-c846-419e-a33f-860b071d3b18 for instance with vm_state building and task_state spawning.
Nov 14 02:07:55 user nova-compute[75257]: INFO nova.compute.manager [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Took 8.28 seconds to build instance.
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.444s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-50eb2c39-7f23-40c5-aae6-ec2c04293306 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.413s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:56 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Snapshot image upload complete
Nov 14 02:07:56 user nova-compute[75257]: INFO nova.compute.manager [None req-f9048ed0-7620-4af6-9037-1d8cd111a88d tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Took 6.60 seconds to snapshot the instance on the hypervisor.
Nov 14 02:07:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23936303438333237', 'path': '/dev/sdd'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936303438333237', 'path': '/dev/sdd'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG nova.objects.instance [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] No VIF found with MAC fa:16:3e:cc:f8:11, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:07:56 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:07:56 user nova-compute[75257]:   <source dev="/dev/sdd"/>
Nov 14 02:07:56 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:07:56 user nova-compute[75257]:   <serial>399fd6d1-cc6f-432c-96c2-eb97da1c0ceb</serial>
Nov 14 02:07:56 user nova-compute[75257]: </disk>
Nov 14 02:07:56 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG nova.compute.manager [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received event network-vif-plugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG nova.compute.manager [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] No waiting events found dispatching network-vif-plugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:07:56 user nova-compute[75257]: WARNING nova.compute.manager [req-4c4be32f-c214-4408-9f99-3bf2f2ac2a26 req-2ba8c1d1-4692-4e12-b3da-ca833998b703 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received unexpected event network-vif-plugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance with vm_state building and task_state spawning.
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-583fc8ed-1f64-41c4-a953-cadaf323b18e tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.566s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No VIF found with MAC fa:16:3e:69:41:ac, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:57 user nova-compute[75257]: INFO nova.compute.manager [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Terminating instance
Nov 14 02:07:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-52c6cdef-7f58-4fcb-a1f4-694602bebeb7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.445s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.009s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75257) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG nova.objects.instance [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Instance destroyed successfully.
Nov 14 02:07:57 user nova-compute[75257]: DEBUG nova.objects.instance [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lazy-loading 'resources' on Instance uuid 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-42747156',display_name='tempest-DeleteServersTestJSON-server-42747156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-42747156',id=1,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be0fe3e87f6d484f8f205662dcc31a4b',ramdisk_id='',reservation_id='r-cnhikt9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-204082231',owner_user_name='tempest-DeleteServersTestJSON-204082231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:15Z,user_data=None,user_id='5ca1c02f69824ccabfbf9ada3f202403',uuid=8344b1ae-c8b7-4b30-b88e-9b554b5d3dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Converting VIF {"id": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "address": "fa:16:3e:cc:f8:11", "network": {"id": "0ce4ee69-8517-419c-a70e-bfa199241285", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1833773291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be0fe3e87f6d484f8f205662dcc31a4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b1674a-e2", "ovs_interfaceid": "57b1674a-e229-46ea-ba3e-2b8d57a9b518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=57b1674a-e229-46ea-ba3e-2b8d57a9b518,network=Network(0ce4ee69-8517-419c-a70e-bfa199241285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b1674a-e2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_vif [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=57b1674a-e229-46ea-ba3e-2b8d57a9b518,network=Network(0ce4ee69-8517-419c-a70e-bfa199241285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b1674a-e2') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57b1674a-e2, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-unplugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-unplugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:07:58 user nova-compute[75257]: WARNING nova.compute.manager [req-e048ef6b-891d-4854-8c5a-fce1c8b7e0cb req-d7f84a03-f796-4f6a-823c-27d43f06575d service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-unplugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state active and task_state powering-off.
Nov 14 02:07:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=687b21df-1905-4f2c-936e-885223a649fe) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: INFO os_vif [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f8:11,bridge_name='br-int',has_traffic_filtering=True,id=57b1674a-e229-46ea-ba3e-2b8d57a9b518,network=Network(0ce4ee69-8517-419c-a70e-bfa199241285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b1674a-e2')
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OEAwkWay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:07:58 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6c177f-07dd-49a6-b24d-5ff3a7a4f25e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:07:58 user nova-compute[75257]: No targets found.
Nov 14 02:07:58 user nova-compute[75257]: iSNS:
Nov 14 02:07:58 user nova-compute[75257]: No targets found.
Nov 14 02:07:58 user nova-compute[75257]: STATIC:
Nov 14 02:07:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:07:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:07:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:07:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7
Nov 14 02:07:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:07:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:07:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3
Nov 14 02:07:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:07:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:07:58 user nova-compute[75257]: FIRMWARE:
Nov 14 02:07:58 user nova-compute[75257]: No targets found.
Nov 14 02:07:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:07:58 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:07:58 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb111dbf-962b-4f30-bc50-e025a3a5aca7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15ea5b9-5cf4-44e7-8bb5-67b92286b3ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:58 user nova-compute[75257]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)
Nov 14 02:07:58 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:07:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:07:58 user nova-compute[75257]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 (non-flash)
Nov 14 02:07:58 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:07:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a414eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf8917a-a42c-4fe0-85f0-9649a23c384c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[74da5404-3d8a-4a62-966f-6b9403e01f6a]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b8f7e-0b5c-4041-b841-6ef37f24d2f3]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a774f8-2e9b-4a6b-a717-feee68ffc955]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0577d5-524b-4db5-ba8b-2b1a0e298f86]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d3b911-4944-4068-9660-e8c7b7474dc6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3, portal: 172.16.0.220,3260]
Nov 14 02:07:58 user nova-compute[75257]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3, portal: 172.16.0.220,3260] successful.
Nov 14 02:07:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67d3d4c4-83a2-43e0-ab0a-b532171bf9c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd2f320-4d5c-47f0-8bcc-0131102d465f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] <== disconnect_volume: return (378ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:07:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Deleting instance files /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba_del
Nov 14 02:07:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Deletion of /opt/stack/data/nova/instances/8344b1ae-c8b7-4b30-b88e-9b554b5d3dba_del complete
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received event network-vif-plugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] No waiting events found dispatching network-vif-plugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:07:58 user nova-compute[75257]: WARNING nova.compute.manager [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received unexpected event network-vif-plugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance with vm_state building and task_state spawning.
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received event network-vif-unplugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Acquiring lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] No waiting events found dispatching network-vif-unplugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received event network-vif-unplugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received event network-vif-plugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Acquiring lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] No waiting events found dispatching network-vif-plugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:07:58 user nova-compute[75257]: WARNING nova.compute.manager [req-007a6130-700c-4a29-95e2-2df2a99dcbdc req-d0581a73-de26-4b67-9c69-799530319ca8 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received unexpected event network-vif-plugged-57b1674a-e229-46ea-ba3e-2b8d57a9b518 for instance with vm_state active and task_state deleting.
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:07:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance destroyed successfully.
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:07:58 user nova-compute[75257]: INFO nova.compute.manager [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-99bf3e1f-cb3a-49f0-8d42-a5af365e7bd6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.032s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:07:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:59 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Instance spawned successfully.
Nov 14 02:07:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:07:59 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Took 0.57 seconds to deallocate network for instance.
Nov 14 02:07:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:07:59 user nova-compute[75257]: INFO nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Took 7.96 seconds to spawn the instance on the hypervisor.
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:07:59 user nova-compute[75257]: INFO nova.compute.manager [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Took 8.99 seconds to build instance.
Nov 14 02:07:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-594efa7c-ce4e-43bd-9bba-96a7c836f356 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.120s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:07:59 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:07:59 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:07:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=6983MB free_disk=25.4852294921875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:07:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:00 user nova-compute[75257]: INFO nova.compute.manager [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Took 0.88 seconds to detach 1 volumes for instance.
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 71a9d20f-e79b-4716-abf8-a15330742167 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2f9df98c-7814-419d-8821-d8c571972f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance fd62b270-19d7-45e5-bd66-a94c384050bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a1326183-c4cb-40fa-a352-470e2c69cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b950c25e-2910-4de3-a9fc-30e4091dfe19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:00 user nova-compute[75257]: WARNING nova.compute.manager [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state stopped and task_state None.
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-7f825a83-7828-414e-bcef-6465518b3d7c req-ec1a52f5-58a5-4bf3-8ddd-352a8d8d42f5 service nova] [instance: 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba] Received event network-vif-deleted-57b1674a-e229-46ea-ba3e-2b8d57a9b518 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.384s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:08:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:00 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Deleted allocations for instance 8344b1ae-c8b7-4b30-b88e-9b554b5d3dba
Nov 14 02:08:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-40d6e8b7-04a9-421c-801e-f75307861b55 tempest-DeleteServersTestJSON-204082231 tempest-DeleteServersTestJSON-204082231-project-member] Lock "8344b1ae-c8b7-4b30-b88e-9b554b5d3dba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.927s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received event network-changed-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Refreshing instance network info cache due to event network-changed-aa2867e8-4cfe-415e-96a1-881199b73c4c. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:08:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] Acquiring lock "refresh_cache-fd62b270-19d7-45e5-bd66-a94c384050bd" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:08:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] Acquired lock "refresh_cache-fd62b270-19d7-45e5-bd66-a94c384050bd" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:08:01 user nova-compute[75257]: DEBUG nova.network.neutron [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Refreshing network info cache for port aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:08:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Updated VIF entry in instance network info cache for port aa2867e8-4cfe-415e-96a1-881199b73c4c. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:08:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Updating instance_info_cache with network_info: [{"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:08:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2f37e58b-01a9-4aee-9b4f-4286b86bd318 req-e24fb6ed-ca57-4d81-a448-9ea93cdde3b5 service nova] Releasing lock "refresh_cache-fd62b270-19d7-45e5-bd66-a94c384050bd" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lazy-loading 'flavor' on Instance uuid fd62b270-19d7-45e5-bd66-a94c384050bd {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received event network-changed-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Refreshing instance network info cache due to event network-changed-e21c8d5d-3420-4c0d-8677-74cc2edef2cf. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] Acquiring lock "refresh_cache-0bbd75fc-a135-4bc6-8853-e28dfc6219c1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] Acquired lock "refresh_cache-0bbd75fc-a135-4bc6-8853-e28dfc6219c1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Refreshing network info cache for port e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:03 user nova-compute[75257]: INFO nova.compute.manager [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Attaching volume c867f218-68b6-44eb-bf84-2d3e1644eeb2 to /dev/vdb
Nov 14 02:08:03 user nova-compute[75257]: DEBUG os_brick.utils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dd20d3-b213-468b-b87c-c1f0f053bb06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[06129b58-b95c-4a33-b414-ec1d9248498f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc28bae-da76-4f7d-9b06-fcf2440946a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cdbb91-3c89-4e09-a003-fe928a431ad9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:04 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[59538c8a-b188-479d-b913-008960217290]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG os_brick.utils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Updating existing volume attachment record: 2f24274c-617d-455e-9c5d-301d6671cf48 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG nova.network.neutron [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Updated VIF entry in instance network info cache for port e21c8d5d-3420-4c0d-8677-74cc2edef2cf. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG nova.network.neutron [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Updating instance_info_cache with network_info: [{"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ede310f0-2786-4166-8999-236d29b220f7 req-8743062e-448f-4e0d-a077-af5b5a787608 service nova] Releasing lock "refresh_cache-0bbd75fc-a135-4bc6-8853-e28dfc6219c1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:04 user nova-compute[75257]: DEBUG nova.objects.instance [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lazy-loading 'flavor' on Instance uuid 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:05 user nova-compute[75257]: INFO nova.compute.manager [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Attaching volume 3bf11fc4-8a29-4374-b194-5c840e14fd7b to /dev/sdc
Nov 14 02:08:05 user nova-compute[75257]: DEBUG os_brick.utils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2364d-af1a-4deb-a967-c09deb54c203]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f460646f-86aa-4886-8e3f-0941e8f12929]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[397a7a8b-9b5e-4b8e-8aa4-9599095471f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eed7652-1056-452f-958a-013ca6aff456]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:05 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:08:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[95db0287-5bf7-4403-ae27-d97772edc162]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG os_brick.utils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:05 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Updating existing volume attachment record: 0e8be532-3c14-4d11-aee2-004c188fb388 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:08:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-changed-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Refreshing instance network info cache due to event network-changed-f0fa855e-494f-4fb7-9c5b-2022578e7a9e. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] Acquiring lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] Acquired lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG nova.network.neutron [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Refreshing network info cache for port f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ICkZdfvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:08 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:08 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:08 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b619584-9689-49f3-b3df-ca0fb1339352]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:08:08 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e2ea9b-2b8a-4807-a5fc-c9ce7c295273]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2] added
Nov 14 02:08:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceb754a-e705-467f-85fe-de1fd969382c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9266b30-b582-42f3-ad44-0e754050666f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ICkZdfvS {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ICkZdfvS" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9839edc8-95b1-4e36-af57-bf3615a459dd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ICkZdfvS'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d863f7-20b7-44b0-9db2-6f133a0958a4]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d918b0a-bc92-4c79-9431-414f79561c82]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:09 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:09 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b139bb-032b-4f06-8634-5bc3d7f17147]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2, portal: 172.16.0.220,3260]
Nov 14 02:08:09 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2ae5d4-ca9c-40b7-ab70-7ab073b46426]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "interface-8de0ee5b-852a-4146-ba87-378181e1cfc4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "interface-8de0ee5b-852a-4146-ba87-378181e1cfc4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lazy-loading 'flavor' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a079f3e-81d6-4830-9801-67ed72a73eb8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:09 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:09 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:09 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:09 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f7afe2-fd42-4758-9c8b-62df3b1605aa]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ICkZdfvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lazy-loading 'pci_requests' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG nova.objects.base [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Object Instance<8de0ee5b-852a-4146-ba87-378181e1cfc4> lazy-loaded attributes: flavor,pci_requests {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updated VIF entry in instance network info cache for port f0fa855e-494f-4fb7-9c5b-2022578e7a9e. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updating instance_info_cache with network_info: [{"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG nova.policy [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ca1d05e84d74c1ab74521dcc91f3f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe096d58b812473296c75ad5d3d5c924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d7012e78-c436-4092-9a90-d35408f77a9a req-c9b9fb51-ae79-4f97-8054-38b2d7ffe47d service nova] Releasing lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nhYNWLaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:09 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Successfully created port: 07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23335303261376536', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335303261376536', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.522s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:10 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:10 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lazy-loading 'flavor' on Instance uuid fd62b270-19d7-45e5-bd66-a94c384050bd {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2054438-9c41-4c7e-a0af-c7b78f3a4f66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:08:10 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:08:10 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:10 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:08:10 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:08:10 user nova-compute[75257]:   <serial>c867f218-68b6-44eb-bf84-2d3e1644eeb2</serial>
Nov 14 02:08:10 user nova-compute[75257]: </disk>
Nov 14 02:08:10 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a42be-c9d8-4644-afd4-879d783fab82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b] added
Nov 14 02:08:10 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1444a5-36ae-40f7-99a0-b7c6208e86bc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9598e89-6113-4324-8615-8b33729415f5]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nhYNWLaI {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nhYNWLaI" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2b94c2-2840-4b85-930d-53878bd27444]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nhYNWLaI'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af35f39a-eaec-4799-a9c6-cd8685596b8a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f297e1-cb37-4b1e-b784-075fe7e4639f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:10 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:10 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c821fe-f609-41a3-b115-ac3fd4aa591f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b, portal: 172.16.0.220,3260]
Nov 14 02:08:10 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:10 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b52241-351f-40a9-91a8-545123a2d343]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da697e0-64a2-4183-abc4-48583bd96d13]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:10 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:10 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:10 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b96b8-3128-43ff-a46f-358a56f95186]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nhYNWLaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Successfully updated port: 07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquired lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-changed-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Refreshing instance network info cache due to event network-changed-07b9ece5-ed71-42e9-ae00-72829af206e8. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] Acquiring lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] No VIF found with MAC fa:16:3e:3b:2e:bd, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:08:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f183bdf7-c036-4451-b5e7-d842ee64ccd9 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.971s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updating instance_info_cache with network_info: [{"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Releasing lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] Acquired lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Refreshing network info cache for port 07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053798230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053798230',id=8,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA==',key_name='tempest-keypair-1715447766',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe096d58b812473296c75ad5d3d5c924',ramdisk_id='',reservation_id='r-m0bnejek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1006457440',owner_user_name='tempest-TaggedAttachmentsTest-1006457440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ca1d05e84d74c1ab74521dcc91f3f38',uuid=8de0ee5b-852a-4146-ba87-378181e1cfc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converting VIF {"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG os_vif [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7040179f-a1b5-536b-b63c-1cce0ecc77fa', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07b9ece5-ed, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07b9ece5-ed, col_values=(('qos', UUID('fd8264dc-7b70-443d-ac44-0a6c300886ec')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07b9ece5-ed, col_values=(('external_ids', {'iface-id': '07b9ece5-ed71-42e9-ae00-72829af206e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:dd:f5', 'vm-uuid': '8de0ee5b-852a-4146-ba87-378181e1cfc4'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: INFO os_vif [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed')
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053798230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053798230',id=8,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA==',key_name='tempest-keypair-1715447766',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe096d58b812473296c75ad5d3d5c924',ramdisk_id='',reservation_id='r-m0bnejek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1006457440',owner_user_name='tempest-TaggedAttachmentsTest-1006457440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ca1d05e84d74c1ab74521dcc91f3f38',uuid=8de0ee5b-852a-4146-ba87-378181e1cfc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converting VIF {"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] attach device xml: <interface type="ethernet">
Nov 14 02:08:11 user nova-compute[75257]:   <mac address="fa:16:3e:35:dd:f5"/>
Nov 14 02:08:11 user nova-compute[75257]:   <model type="virtio"/>
Nov 14 02:08:11 user nova-compute[75257]:   <mtu size="1442"/>
Nov 14 02:08:11 user nova-compute[75257]:   <target dev="tap07b9ece5-ed"/>
Nov 14 02:08:11 user nova-compute[75257]: </interface>
Nov 14 02:08:11 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] <== connect_volume: return (1844ms) {'type': 'block', 'scsi_wwn': '23634396466643362', 'path': '/dev/sde'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634396466643362', 'path': '/dev/sde'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.objects.instance [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lazy-loading 'flavor' on Instance uuid 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:08:11 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:11 user nova-compute[75257]:   <source dev="/dev/sde"/>
Nov 14 02:08:11 user nova-compute[75257]:   <target dev="sdc" bus="scsi"/>
Nov 14 02:08:11 user nova-compute[75257]:   <serial>3bf11fc4-8a29-4374-b194-5c840e14fd7b</serial>
Nov 14 02:08:11 user nova-compute[75257]:   <address type="drive" controller="0" unit="2"/>
Nov 14 02:08:11 user nova-compute[75257]: </disk>
Nov 14 02:08:11 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updated VIF entry in instance network info cache for port 07b9ece5-ed71-42e9-ae00-72829af206e8. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updating instance_info_cache with network_info: [{"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] No BDM found with device name hda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] No VIF found with MAC fa:16:3e:a2:65:b2, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-60627e39-0636-44db-8b25-8a2a1914ffe3 req-c5c0caae-6d70-4ef3-b14c-3992afbf2346 service nova] Releasing lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:08:11 user nova-compute[75257]:   <nova:package version="0.0.0"/>
Nov 14 02:08:11 user nova-compute[75257]:   <nova:name>tempest-device-tagging-server-1053798230</nova:name>
Nov 14 02:08:11 user nova-compute[75257]:   <nova:creationTime>2023-11-14 02:08:11</nova:creationTime>
Nov 14 02:08:11 user nova-compute[75257]:   <nova:flavor name="m1.tiny">
Nov 14 02:08:11 user nova-compute[75257]:     <nova:memory>512</nova:memory>
Nov 14 02:08:11 user nova-compute[75257]:     <nova:disk>1</nova:disk>
Nov 14 02:08:11 user nova-compute[75257]:     <nova:swap>0</nova:swap>
Nov 14 02:08:11 user nova-compute[75257]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:08:11 user nova-compute[75257]:     <nova:vcpus>1</nova:vcpus>
Nov 14 02:08:11 user nova-compute[75257]:   </nova:flavor>
Nov 14 02:08:11 user nova-compute[75257]:   <nova:owner>
Nov 14 02:08:11 user nova-compute[75257]:     <nova:user uuid="3ca1d05e84d74c1ab74521dcc91f3f38">tempest-TaggedAttachmentsTest-1006457440-project-member</nova:user>
Nov 14 02:08:11 user nova-compute[75257]:     <nova:project uuid="fe096d58b812473296c75ad5d3d5c924">tempest-TaggedAttachmentsTest-1006457440</nova:project>
Nov 14 02:08:11 user nova-compute[75257]:   </nova:owner>
Nov 14 02:08:11 user nova-compute[75257]:   <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:08:11 user nova-compute[75257]:   <nova:ports>
Nov 14 02:08:11 user nova-compute[75257]:     <nova:port uuid="f0fa855e-494f-4fb7-9c5b-2022578e7a9e">
Nov 14 02:08:11 user nova-compute[75257]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:08:11 user nova-compute[75257]:     </nova:port>
Nov 14 02:08:11 user nova-compute[75257]:     <nova:port uuid="07b9ece5-ed71-42e9-ae00-72829af206e8">
Nov 14 02:08:11 user nova-compute[75257]:       <nova:ip type="fixed" address="10.10.10.254" ipVersion="4"/>
Nov 14 02:08:11 user nova-compute[75257]:     </nova:port>
Nov 14 02:08:11 user nova-compute[75257]:   </nova:ports>
Nov 14 02:08:11 user nova-compute[75257]: </nova:instance>
Nov 14 02:08:11 user nova-compute[75257]:  {{(pid=75257) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 02:08:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8fbad253-19c6-48c4-870a-e7c7000b7f70 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "interface-8de0ee5b-852a-4146-ba87-378181e1cfc4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.763s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:12 user nova-compute[75257]: INFO nova.compute.manager [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Detaching volume c867f218-68b6-44eb-bf84-2d3e1644eeb2
Nov 14 02:08:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:12 user nova-compute[75257]: INFO nova.virt.block_device [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Attempting to driver detach volume c867f218-68b6-44eb-bf84-2d3e1644eeb2 from mountpoint /dev/vdb
Nov 14 02:08:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Attempting to detach device vdb from instance fd62b270-19d7-45e5-bd66-a94c384050bd from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:08:12 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:12 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:08:12 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:08:12 user nova-compute[75257]:   <serial>c867f218-68b6-44eb-bf84-2d3e1644eeb2</serial>
Nov 14 02:08:12 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:08:12 user nova-compute[75257]: </disk>
Nov 14 02:08:12 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:12 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Successfully detached device vdb from instance fd62b270-19d7-45e5-bd66-a94c384050bd from the persistent domain config.
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd62b270-19d7-45e5-bd66-a94c384050bd from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:08:12 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:12 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:08:12 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:08:12 user nova-compute[75257]:   <serial>c867f218-68b6-44eb-bf84-2d3e1644eeb2</serial>
Nov 14 02:08:12 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:08:12 user nova-compute[75257]: </disk>
Nov 14 02:08:12 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] No BDM found with device name sda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] No VIF found with MAC fa:16:3e:de:10:16, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.objects.instance [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lazy-loading 'flavor' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-04dfb6a6-eed0-4783-9acb-90948aa6430b tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.131s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:12 user nova-compute[75257]: INFO nova.compute.manager [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Attaching volume 71282f04-b577-4513-8383-3f7510c0c6f1 to /dev/vdb
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd62b270-19d7-45e5-bd66-a94c384050bd {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG os_brick.utils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1469814f-359c-4c9b-9fd0-8e19219a3691]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8bb1c2-a158-4d55-aac1-a7626c324d0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbce9be4-020b-4ab0-a9f8-9010ef859c61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2da531-5530-4d62-a584-5ed5c928623a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:12 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f963c5-993c-4fb6-87ee-f27caa68964f]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG os_brick.utils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updating existing volume attachment record: 949b41a1-5e2b-462f-afa5-03d65cddd7b5 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-plugged-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-plugged-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:12 user nova-compute[75257]: WARNING nova.compute.manager [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-plugged-07b9ece5-ed71-42e9-ae00-72829af206e8 for instance with vm_state active and task_state None.
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-plugged-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-plugged-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:12 user nova-compute[75257]: WARNING nova.compute.manager [req-e707010b-69dc-4a1a-9a7e-6c67e6d7536a req-f44f6e94-ccd0-450a-bd8f-8bd3eba10d4e service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-plugged-07b9ece5-ed71-42e9-ae00-72829af206e8 for instance with vm_state active and task_state None.
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:13 user nova-compute[75257]: INFO nova.compute.manager [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Detaching volume 3bf11fc4-8a29-4374-b194-5c840e14fd7b
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lazy-loading 'flavor' on Instance uuid a1326183-c4cb-40fa-a352-470e2c69cb05 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:13 user nova-compute[75257]: INFO nova.virt.block_device [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Attempting to driver detach volume 3bf11fc4-8a29-4374-b194-5c840e14fd7b from mountpoint /dev/sdc
Nov 14 02:08:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Attempting to detach device sdc from instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:08:13 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:13 user nova-compute[75257]:   <source dev="/dev/sde"/>
Nov 14 02:08:13 user nova-compute[75257]:   <target dev="sdc" bus="scsi"/>
Nov 14 02:08:13 user nova-compute[75257]:   <serial>3bf11fc4-8a29-4374-b194-5c840e14fd7b</serial>
Nov 14 02:08:13 user nova-compute[75257]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 02:08:13 user nova-compute[75257]: </disk>
Nov 14 02:08:13 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:13 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Successfully detached device sdc from instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 from the persistent domain config.
Nov 14 02:08:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:08:13 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:13 user nova-compute[75257]:   <source dev="/dev/sde"/>
Nov 14 02:08:13 user nova-compute[75257]:   <target dev="sdc" bus="scsi"/>
Nov 14 02:08:13 user nova-compute[75257]:   <serial>3bf11fc4-8a29-4374-b194-5c840e14fd7b</serial>
Nov 14 02:08:13 user nova-compute[75257]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 02:08:13 user nova-compute[75257]: </disk>
Nov 14 02:08:13 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:13 user nova-compute[75257]: INFO nova.compute.manager [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Attaching volume 9c24d19d-34aa-4f62-886b-3b261a4af901 to /dev/vdb
Nov 14 02:08:13 user nova-compute[75257]: DEBUG os_brick.utils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6017b57e-1db4-4b47-bf4d-e799110f13d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3145521-b27b-4b94-b556-ecd2263952c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[297cae69-9818-4403-b80f-4ad63c81f7a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[933aec10-6d54-4b08-b4c5-72b3cb044ef9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:13 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:08:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8186ef69-602c-40ad-ba3b-bc30a07dd579]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG os_brick.utils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Updating existing volume attachment record: dde2dc60-a615-4c45-9d71-1a475d7295ea {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:08:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:08:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received event network-changed-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Refreshing instance network info cache due to event network-changed-fb5f3206-b474-4ff1-b22a-ec6169264796. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:08:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] Acquiring lock "refresh_cache-a1326183-c4cb-40fa-a352-470e2c69cb05" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:08:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] Acquired lock "refresh_cache-a1326183-c4cb-40fa-a352-470e2c69cb05" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:08:14 user nova-compute[75257]: DEBUG nova.network.neutron [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Refreshing network info cache for port fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:08:15 user nova-compute[75257]: DEBUG nova.network.neutron [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Updated VIF entry in instance network info cache for port fb5f3206-b474-4ff1-b22a-ec6169264796. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:08:15 user nova-compute[75257]: DEBUG nova.network.neutron [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Updating instance_info_cache with network_info: [{"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:08:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4c7c244c-329d-4908-bb51-bbef303700ae req-c649851e-067a-4203-8fe3-996c30e89096 service nova] Releasing lock "refresh_cache-a1326183-c4cb-40fa-a352-470e2c69cb05" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:08:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-changed-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Refreshing instance network info cache due to event network-changed-7c8790c5-8202-4e02-94e3-3581d766cc78. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:08:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] Acquiring lock "refresh_cache-42d01836-ef5a-4dba-ab6a-49bfe7976879" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:08:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] Acquired lock "refresh_cache-42d01836-ef5a-4dba-ab6a-49bfe7976879" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:08:18 user nova-compute[75257]: DEBUG nova.network.neutron [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Refreshing network info cache for port 7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:08:19 user nova-compute[75257]: DEBUG nova.network.neutron [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Updated VIF entry in instance network info cache for port 7c8790c5-8202-4e02-94e3-3581d766cc78. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:08:19 user nova-compute[75257]: DEBUG nova.network.neutron [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Updating instance_info_cache with network_info: [{"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:08:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8f4643c9-2eed-4d6a-8a00-db2f41da1682 req-37cdae0e-b523-49d2-8683-5d80b9e3f2fc service nova] Releasing lock "refresh_cache-42d01836-ef5a-4dba-ab6a-49bfe7976879" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:08:19 user nova-compute[75257]: INFO nova.compute.manager [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Rebuilding instance
Nov 14 02:08:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:08:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance destroyed successfully.
Nov 14 02:08:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance destroyed successfully.
Nov 14 02:08:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1126017660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-830117018',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgf2fXbCY9rsjb34KMUST8SMXto50nACORXEnnMj+K0J2fgBaFnj6x23XOrkc5PvkSbOH/DwnZ6aLyMOr4VrPPGI6VOba5H/JsmvGMycdDB8yWuFuzI/QXeNX4GuWC8IA==',key_name='tempest-keypair-586767792',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='91262b32dbc949beb98767d004ff9a73',ramdisk_id='',reservation_id='r-mljiki2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-358377017',owner_user_name='tempest-ServerActionsV293TestJSON-358377017-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:08:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67156afa3d24427e90e99f944362ecfe',uuid=42d01836-ef5a-4dba-ab6a-49bfe7976879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converting VIF {"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_vif [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c8790c5-82, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f23e33e-5491-4e11-9e99-613d3c5a1b43) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:20 user nova-compute[75257]: INFO os_vif [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82')
Nov 14 02:08:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNrvPjld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:20 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf975ec-5772-4ada-8bc0-1f5fb68be5aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:08:20 user nova-compute[75257]: No targets found.
Nov 14 02:08:20 user nova-compute[75257]: iSNS:
Nov 14 02:08:20 user nova-compute[75257]: No targets found.
Nov 14 02:08:20 user nova-compute[75257]: STATIC:
Nov 14 02:08:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2
Nov 14 02:08:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:08:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b
Nov 14 02:08:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7
Nov 14 02:08:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:20 user nova-compute[75257]: FIRMWARE:
Nov 14 02:08:20 user nova-compute[75257]: No targets found.
Nov 14 02:08:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:08:20 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:08:20 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-unplugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] No waiting events found dispatching network-vif-unplugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:20 user nova-compute[75257]: WARNING nova.compute.manager [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received unexpected event network-vif-unplugged-7c8790c5-8202-4e02-94e3-3581d766cc78 for instance with vm_state active and task_state rebuilding.
Nov 14 02:08:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] No waiting events found dispatching network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:20 user nova-compute[75257]: WARNING nova.compute.manager [req-27eb33d5-2ad0-4cb4-a9b2-da0e20b21700 req-4ded255e-ae44-464f-bc59-148c465d40e2 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received unexpected event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 for instance with vm_state active and task_state rebuilding.
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27cbfd5-65d7-4110-a94b-afcd64d99ec7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e3cce-ea00-4835-acc2-2573e4dd9158]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:20 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:20 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:20 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:20 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:20 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:20 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a414d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56abb24-4c7d-413f-8dc8-e10a55251a1e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfa4ae0-7e39-481d-b584-8c7e625838d9]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe88cfd-01ab-492c-b1a8-df5055cbce9a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c69e174-f3cb-41c2-88ba-5b993893fbfe]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[22adead5-629b-4c28-811b-91f53886b000]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[167dd147-4894-4427-83b7-a3175f3f14cd]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260]
Nov 14 02:08:20 user nova-compute[75257]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8d28d6-93da-4b08-b379-8f4b8012509c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] <== disconnect_volume: return (322ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:08:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Deleting instance files /opt/stack/data/nova/instances/42d01836-ef5a-4dba-ab6a-49bfe7976879_del
Nov 14 02:08:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Deletion of /opt/stack/data/nova/instances/42d01836-ef5a-4dba-ab6a-49bfe7976879_del complete
Nov 14 02:08:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiIdxeRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:21 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:21 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:21 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 could not be found.
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[787c6e05-8766-4fa8-9f55-c87e450e6478]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:08:21 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNrvPjld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:21 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOJTkPEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:21 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5301798-82e6-47b4-ab31-e8007e5797e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1] added
Nov 14 02:08:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ff6de-9fbd-44df-a13c-807806380885]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd50c89-be96-4f92-8741-79d083a08134]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiIdxeRp {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiIdxeRp" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5442a4d1-a444-4ad4-b411-203c485bcbec]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CiIdxeRp'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa5f97-6da6-40e7-9909-0d6a97a5f8f7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[526235d2-59ab-46d2-b5d8-e433295bef08]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ecdfc7-8a66-4eaf-8060-178753e464aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1, portal: 172.16.0.220,3260]
Nov 14 02:08:21 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[85772ac1-9bb2-4486-8f9a-344366f39f6e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[529d14f8-f50a-480e-a552-8920bc7becfc]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:21 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6b354f-008c-43e0-aa26-c3bb244a704e]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:08:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiIdxeRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26139656633353264', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139656633353264', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.367s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG nova.objects.instance [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lazy-loading 'flavor' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[843d6d42-36ff-47ae-9cca-18565f48a1df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:08:22 user nova-compute[75257]: No targets found.
Nov 14 02:08:22 user nova-compute[75257]: iSNS:
Nov 14 02:08:22 user nova-compute[75257]: No targets found.
Nov 14 02:08:22 user nova-compute[75257]: STATIC:
Nov 14 02:08:22 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2
Nov 14 02:08:22 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:22 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:22 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:08:22 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:22 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:22 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b
Nov 14 02:08:22 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:22 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:22 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1
Nov 14 02:08:22 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:22 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:22 user nova-compute[75257]: FIRMWARE:
Nov 14 02:08:22 user nova-compute[75257]: No targets found.
Nov 14 02:08:22 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:08:22 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:08:22 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:08:22 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:22 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:08:22 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:08:22 user nova-compute[75257]:   <serial>71282f04-b577-4513-8383-3f7510c0c6f1</serial>
Nov 14 02:08:22 user nova-compute[75257]: </disk>
Nov 14 02:08:22 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[003ae29b-a5c6-454d-b153-e6dc5ee039d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[351640d4-b96d-40f8-abaf-03cbca302a29]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a41acf70>, {}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Disconnecting from: [] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] <== disconnect_volume: return (1448ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.447s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:22 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:22 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[120694f4-12a6-4cd5-b548-1a801dea341f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:08:22 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b864a3a-c7ff-4125-84c1-d9166293effb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901] added
Nov 14 02:08:22 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da04d60-b10f-4a58-8499-298eb13497be]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[01681bfb-6472-44ce-a5ad-ea06ba18e953]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOJTkPEA {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOJTkPEA" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b831a52-628a-4e55-a1c6-fa81de9d2700]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SOJTkPEA'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5b51e8-9893-4a6f-8df5-06a18a6d5d03]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0d0f19-58d7-46e6-9c0b-3d1e9371fd8f]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac544b36-59ae-4172-b427-fea50ca814ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901, portal: 172.16.0.220,3260]
Nov 14 02:08:22 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:22 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd80f48-6f96-49c9-ac89-aa13ef96821e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef38f5e-fc34-44d5-9890-963f2e20f8da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:22 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:22 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:22 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[56132273-b4ec-456b-b847-d45bb0cf672d]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOJTkPEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] No BDM found with device name hda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] No VIF found with MAC fa:16:3e:a2:65:b2, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-18101f21-c17a-4d0e-bec4-6d12575a4f73 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.675s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG nova.compute.manager [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Preparing to wait for external event volume-reimaged-63a8b1e6-4579-48f6-8a4c-b75386826ce7 {{(pid=75257) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:23 user nova-compute[75257]: INFO nova.compute.manager [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Detaching volume 71282f04-b577-4513-8383-3f7510c0c6f1
Nov 14 02:08:23 user nova-compute[75257]: INFO nova.virt.block_device [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Attempting to driver detach volume 71282f04-b577-4513-8383-3f7510c0c6f1 from mountpoint /dev/vdb
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Attempting to detach device vdb from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:08:24 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:24 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:08:24 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:08:24 user nova-compute[75257]:   <serial>71282f04-b577-4513-8383-3f7510c0c6f1</serial>
Nov 14 02:08:24 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 02:08:24 user nova-compute[75257]: </disk>
Nov 14 02:08:24 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] <== connect_volume: return (2783ms) {'type': 'block', 'scsi_wwn': '23333633161356139', 'path': '/dev/sdf'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333633161356139', 'path': '/dev/sdf'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:08:24 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Successfully detached device vdb from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 from the persistent domain config.
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:08:24 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:24 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:08:24 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:08:24 user nova-compute[75257]:   <serial>71282f04-b577-4513-8383-3f7510c0c6f1</serial>
Nov 14 02:08:24 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 02:08:24 user nova-compute[75257]: </disk>
Nov 14 02:08:24 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lazy-loading 'flavor' on Instance uuid a1326183-c4cb-40fa-a352-470e2c69cb05 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 02:08:24 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:24 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:08:24 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:08:24 user nova-compute[75257]:   <serial>9c24d19d-34aa-4f62-886b-3b261a4af901</serial>
Nov 14 02:08:24 user nova-compute[75257]: </disk>
Nov 14 02:08:24 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] No VIF found with MAC fa:16:3e:94:45:07, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ff3913e4-79e9-4f0a-bdd0-49929feaa446 tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.118s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:08:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] volume_snapshot_create: create_info: {'snapshot_id': 'aaa0ffd9-a527-4c1f-8eeb-b22d4acec444', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75257) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 02:08:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] snap xml: <domainsnapshot>
Nov 14 02:08:25 user nova-compute[75257]:   <disks>
Nov 14 02:08:25 user nova-compute[75257]:     <disk name="/dev/sdf" snapshot="external" type="file">
Nov 14 02:08:25 user nova-compute[75257]:       <source file="/dev/new_file"/>
Nov 14 02:08:25 user nova-compute[75257]:     </disk>
Nov 14 02:08:25 user nova-compute[75257]:     <disk name="vda" snapshot="no"/>
Nov 14 02:08:25 user nova-compute[75257]:   </disks>
Nov 14 02:08:25 user nova-compute[75257]: </domainsnapshot>
Nov 14 02:08:25 user nova-compute[75257]:  {{(pid=75257) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 02:08:25 user nova-compute[75257]: DEBUG nova.objects.instance [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Lazy-loading 'system_metadata' on Instance uuid a1326183-c4cb-40fa-a352-470e2c69cb05 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:25 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     rv = execute(f, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     six.reraise(c, e, tb)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     raise value
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     rv = meth(*args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     self._volume_snapshot_create(context, instance, guest,
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     rv = execute(f, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     six.reraise(c, e, tb)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     raise value
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     rv = meth(*args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] 
Nov 14 02:08:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] volume_snapshot_delete: delete_info: {'volume_id': '9c24d19d-34aa-4f62-886b-3b261a4af901'} {{(pid=75257) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05]     if delete_info['type'] != 'qcow2':
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] KeyError: 'type'
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot aaa0ffd9-a527-4c1f-8eeb-b22d4acec444 could not be found.
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot aaa0ffd9-a527-4c1f-8eeb-b22d4acec444 could not be found. (HTTP 404) (Request-ID: req-4fcde84e-45c5-4fcf-b651-34fd7dec5d15)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot aaa0ffd9-a527-4c1f-8eeb-b22d4acec444 could not be found.
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-db3090f0-64db-4cda-85bf-8eb73d3deb64)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 02:08:25 user nova-compute[75257]: ERROR nova.virt.libvirt.driver 
Nov 14 02:08:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server [None req-a74cb803-3711-4d9c-adb1-58ed359f8e37 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server 
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server [None req-913b14e2-0be5-47e3-b157-c333ae4f1de9 tempest-VolumesAssistedSnapshotsTest-353185050 tempest-VolumesAssistedSnapshotsTest-353185050-project] Exception during message handling: KeyError: 'type'
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 02:08:25 user nova-compute[75257]: ERROR oslo_messaging.rpc.server 
Nov 14 02:08:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:25 user nova-compute[75257]: INFO nova.compute.manager [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Detaching volume 9c24d19d-34aa-4f62-886b-3b261a4af901
Nov 14 02:08:25 user nova-compute[75257]: INFO nova.virt.block_device [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Attempting to driver detach volume 9c24d19d-34aa-4f62-886b-3b261a4af901 from mountpoint /dev/vdb
Nov 14 02:08:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Attempting to detach device vdb from instance a1326183-c4cb-40fa-a352-470e2c69cb05 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:08:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 02:08:25 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:25 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:08:25 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:08:25 user nova-compute[75257]:   <serial>9c24d19d-34aa-4f62-886b-3b261a4af901</serial>
Nov 14 02:08:25 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:08:25 user nova-compute[75257]: </disk>
Nov 14 02:08:25 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:25 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Successfully detached device vdb from instance a1326183-c4cb-40fa-a352-470e2c69cb05 from the persistent domain config.
Nov 14 02:08:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1326183-c4cb-40fa-a352-470e2c69cb05 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:08:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 02:08:25 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:25 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:08:25 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:08:25 user nova-compute[75257]:   <serial>9c24d19d-34aa-4f62-886b-3b261a4af901</serial>
Nov 14 02:08:25 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:08:25 user nova-compute[75257]: </disk>
Nov 14 02:08:25 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1326183-c4cb-40fa-a352-470e2c69cb05 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:08:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:32 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd62b270-19d7-45e5-bd66-a94c384050bd is timed out.
Nov 14 02:08:32 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Successfully detached device vdb from instance fd62b270-19d7-45e5-bd66-a94c384050bd from the live domain config.
Nov 14 02:08:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ICkZdfvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:32 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eb38af-ed98-4294-acab-0fd6c7d58d6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:08:32 user nova-compute[75257]: No targets found.
Nov 14 02:08:32 user nova-compute[75257]: iSNS:
Nov 14 02:08:32 user nova-compute[75257]: No targets found.
Nov 14 02:08:32 user nova-compute[75257]: STATIC:
Nov 14 02:08:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2
Nov 14 02:08:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:08:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b
Nov 14 02:08:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7
Nov 14 02:08:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901
Nov 14 02:08:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1
Nov 14 02:08:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:32 user nova-compute[75257]: FIRMWARE:
Nov 14 02:08:32 user nova-compute[75257]: No targets found.
Nov 14 02:08:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:08:32 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:08:32 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fc5789-644f-41a7-ad2e-ab2b9e361420]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c76f0-b16c-45c6-961f-da5fc8554167]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:32 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a414fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5473c500-d06a-4ebf-a459-e5dc81e11b5b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a53ece-8937-436d-ad3a-2b1cc812a0e9]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0666c23-6a59-4219-9763-e29fa6b59c8c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d908000f-f61d-4529-82c9-8a781784ba95]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a88ef0-faf9-4a6b-80c1-4acdb2f18873]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a0c84-ae37-4908-a755-2843d7898846]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2, portal: 172.16.0.220,3260]
Nov 14 02:08:32 user nova-compute[75257]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c867f218-68b6-44eb-bf84-2d3e1644eeb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae152cac-49dd-42ce-9ef3-665eef85d955]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] <== disconnect_volume: return (319ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:08:33 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 is timed out.
Nov 14 02:08:33 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Successfully detached device sdc from instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 from the live domain config.
Nov 14 02:08:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nhYNWLaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:33 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a61c91a-4f48-4a91-bd8a-f436b0f7820b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:08:33 user nova-compute[75257]: No targets found.
Nov 14 02:08:33 user nova-compute[75257]: iSNS:
Nov 14 02:08:33 user nova-compute[75257]: No targets found.
Nov 14 02:08:33 user nova-compute[75257]: STATIC:
Nov 14 02:08:33 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:08:33 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:33 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:33 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b
Nov 14 02:08:33 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:33 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:33 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7
Nov 14 02:08:33 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:33 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:33 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901
Nov 14 02:08:33 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:33 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:33 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1
Nov 14 02:08:33 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:33 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:33 user nova-compute[75257]: FIRMWARE:
Nov 14 02:08:33 user nova-compute[75257]: No targets found.
Nov 14 02:08:33 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:08:33 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:08:33 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG nova.objects.instance [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lazy-loading 'flavor' on Instance uuid fd62b270-19d7-45e5-bd66-a94c384050bd {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f384a43b-97f4-4691-9377-6affa83fcb4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ffb7fe-ff22-4550-bd46-fb79a110cf89]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:33 user nova-compute[75257]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:33 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:33 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:33 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:33 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:33 user nova-compute[75257]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:33 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:33 user nova-compute[75257]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b (non-flash)
Nov 14 02:08:33 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:33 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a435e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b'): ({'sde'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Removing single pathed devices sde {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-31cc7ea1-26da-4415-80c3-70243d09324e tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7a66f3-65f4-450b-9994-f3181af6d339]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a34129-ce99-4b60-a2b6-63ae1b2dcd53]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Flushing IO for device /dev/sde {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33017f0-ed61-47d4-a1ce-425162fcc723]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b755da-5856-4c2f-9abc-0b1c5905bf4e]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[615c19cc-89df-4b28-90c0-8597e06638f7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f068f8eb-b4c3-4a16-8ce4-f6e241e3864b]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b, portal: 172.16.0.220,3260]
Nov 14 02:08:34 user nova-compute[75257]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bf11fc4-8a29-4374-b194-5c840e14fd7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5bab92-96e3-410c-b4da-635f2cd1d18d]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] <== disconnect_volume: return (331ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG nova.objects.instance [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lazy-loading 'flavor' on Instance uuid 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-dda24b7d-7ca0-4a6d-8f29-c674504098f2 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.577s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event volume-reimaged-63a8b1e6-4579-48f6-8a4c-b75386826ce7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f req-42b8f7ae-6f14-4a42-90f3-9fbd2ea655d1 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Processing event volume-reimaged-63a8b1e6-4579-48f6-8a4c-b75386826ce7 {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance event wait completed in 11 seconds for volume-reimaged {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:08:35 user nova-compute[75257]: INFO nova.virt.block_device [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Booting with volume 63a8b1e6-4579-48f6-8a4c-b75386826ce7 at /dev/vda
Nov 14 02:08:35 user nova-compute[75257]: DEBUG os_brick.utils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de00c1-612e-449b-ae39-28f6405a4093]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebe4f83-c21e-4e21-9e9f-9926a3368522]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23053bb-528c-43a2-9ab4-e722f3f5a827]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f7358f-ef43-434f-a489-a329862da7e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:08:35 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:08:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cff4015-fa9e-4d47-9890-45e145829b7c]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG os_brick.utils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Updating existing volume attachment record: 996ef184-f643-45a2-a40d-d2038f67e2b7 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:08:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:36 user nova-compute[75257]: INFO nova.compute.manager [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Terminating instance
Nov 14 02:08:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received event network-vif-unplugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] No waiting events found dispatching network-vif-unplugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-97c595a3-0ae0-4f28-a5c2-0f8b043c14eb req-f20f3d2b-9cb3-4c91-b20e-fd54fc551db1 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received event network-vif-unplugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Instance destroyed successfully.
Nov 14 02:08:36 user nova-compute[75257]: DEBUG nova.objects.instance [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lazy-loading 'resources' on Instance uuid 0bbd75fc-a135-4bc6-8853-e28dfc6219c1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1645257739',display_name='tempest-AttachSCSIVolumeTestJSON-server-1645257739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1645257739',id=7,image_ref='2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhj4EaeRXfb9NhMQegYPjT/0/LNAZQJ+nyOpv1nCt/fNC2YFkT+WEza0vNVeLKvgisEvUQ1Ac56JE3n49AToodAUPgrNFxkJM6n2fLECVtuDKkZ5iI820bK1yg2l6tSHQ==',key_name='tempest-keypair-1154414656',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05fe8be09f614bfcb6ea1bfc3adef743',ramdisk_id='',reservation_id='r-43xuukht',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b796d9a-c967-4a48-b0b7-4d0bc5e3c7d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1301438302',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1301438302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6812b41d5b0f4a35b22dec35cd0d44c6',uuid=0bbd75fc-a135-4bc6-8853-e28dfc6219c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Converting VIF {"id": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "address": "fa:16:3e:de:10:16", "network": {"id": "b8a8607b-2c76-4094-9b20-0a1a967b52ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976075648-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fe8be09f614bfcb6ea1bfc3adef743", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape21c8d5d-34", "ovs_interfaceid": "e21c8d5d-3420-4c0d-8677-74cc2edef2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:10:16,bridge_name='br-int',has_traffic_filtering=True,id=e21c8d5d-3420-4c0d-8677-74cc2edef2cf,network=Network(b8a8607b-2c76-4094-9b20-0a1a967b52ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape21c8d5d-34') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG os_vif [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:10:16,bridge_name='br-int',has_traffic_filtering=True,id=e21c8d5d-3420-4c0d-8677-74cc2edef2cf,network=Network(b8a8607b-2c76-4094-9b20-0a1a967b52ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape21c8d5d-34') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape21c8d5d-34, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8619fba3-8a3e-4e8f-a44e-d3c0438fcdfa) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:08:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:36 user nova-compute[75257]: INFO os_vif [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:10:16,bridge_name='br-int',has_traffic_filtering=True,id=e21c8d5d-3420-4c0d-8677-74cc2edef2cf,network=Network(b8a8607b-2c76-4094-9b20-0a1a967b52ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape21c8d5d-34')
Nov 14 02:08:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Deleting instance files /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1_del
Nov 14 02:08:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Deletion of /opt/stack/data/nova/instances/0bbd75fc-a135-4bc6-8853-e28dfc6219c1_del complete
Nov 14 02:08:37 user nova-compute[75257]: INFO nova.compute.manager [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 02:08:37 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:08:37 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:08:37 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:08:38 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Took 1.24 seconds to deallocate network for instance.
Nov 14 02:08:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received event network-vif-plugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] Acquiring lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] No waiting events found dispatching network-vif-plugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:38 user nova-compute[75257]: WARNING nova.compute.manager [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received unexpected event network-vif-plugged-e21c8d5d-3420-4c0d-8677-74cc2edef2cf for instance with vm_state deleted and task_state None.
Nov 14 02:08:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-9406eea7-84e2-41da-9f77-9cd3ca09bbf6 req-e7f0bfe1-4b02-4cce-a0f7-035dee456c36 service nova] [instance: 0bbd75fc-a135-4bc6-8853-e28dfc6219c1] Received event network-vif-deleted-e21c8d5d-3420-4c0d-8677-74cc2edef2cf {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:08:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:38 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Deleted allocations for instance 0bbd75fc-a135-4bc6-8853-e28dfc6219c1
Nov 14 02:08:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-62df4a19-16df-45fe-8829-3e8b40eb3d16 tempest-AttachSCSIVolumeTestJSON-1301438302 tempest-AttachSCSIVolumeTestJSON-1301438302-project-member] Lock "0bbd75fc-a135-4bc6-8853-e28dfc6219c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.682s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:08:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Creating image(s)
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Ensure instance console log exists: /opt/stack/data/nova/instances/42d01836-ef5a-4dba-ab6a-49bfe7976879/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Start _get_guest_xml network_info=[{"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '996ef184-f643-45a2-a40d-d2038f67e2b7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNrvPjld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42d01836-ef5a-4dba-ab6a-49bfe7976879', 'attached_at': '', 'detached_at': '', 'volume_id': '63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'serial': '63a8b1e6-4579-48f6-8a4c-b75386826ce7'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:08:39 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 02:08:39 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.objects.instance [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42d01836-ef5a-4dba-ab6a-49bfe7976879 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNrvPjld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:39 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:39 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:39 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[deef883b-7ce7-462d-924e-a94e23a002df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:08:39 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b315f8-ca8f-47bb-a571-970b432e8e0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7] added
Nov 14 02:08:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f39368-1625-4432-878a-d95c9bd1db58]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b5b1b9-af40-4bf6-872a-ba7901556cf3]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNrvPjld {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNrvPjld" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[54069ce6-efdb-4ee8-90ea-afd8c947a5d0]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNrvPjld'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ed06ba-d9ee-461b-9e98-e607c618e652]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1824083-30b7-4d5f-a4a4-bd399d1da37d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:39 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:39 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:39 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:39 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f0795-1f84-4772-be6a-e669b024a6ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260]
Nov 14 02:08:40 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[52558840-0193-49a8-8128-817a024e06f9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72af7c9-f7f9-47a9-b092-d6e070ced35d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:40 user nova-compute[75257]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:40 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:40 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:40 user nova-compute[75257]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:40 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:40 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc5fe6e-03e2-496f-a49c-b44759757634]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:08:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNrvPjld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23664373836643738', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664373836643738', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1126017660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-830117018',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgf2fXbCY9rsjb34KMUST8SMXto50nACORXEnnMj+K0J2fgBaFnj6x23XOrkc5PvkSbOH/DwnZ6aLyMOr4VrPPGI6VOba5H/JsmvGMycdDB8yWuFuzI/QXeNX4GuWC8IA==',key_name='tempest-keypair-586767792',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='91262b32dbc949beb98767d004ff9a73',ramdisk_id='',reservation_id='r-mljiki2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-358377017',owner_user_name='tempest-ServerActionsV293TestJSON-358377017-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67156afa3d24427e90e99f944362ecfe',uuid=42d01836-ef5a-4dba-ab6a-49bfe7976879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converting VIF {"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:08:41 user nova-compute[75257]:   <uuid>42d01836-ef5a-4dba-ab6a-49bfe7976879</uuid>
Nov 14 02:08:41 user nova-compute[75257]:   <name>instance-0000000a</name>
Nov 14 02:08:41 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:08:41 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:08:41 user nova-compute[75257]:   <metadata>
Nov 14 02:08:41 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:08:41 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:08:41 user nova-compute[75257]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1126017660</nova:name>
Nov 14 02:08:41 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:08:39</nova:creationTime>
Nov 14 02:08:41 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:08:41 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:08:41 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:08:41 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:08:41 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:08:41 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:08:41 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:08:41 user nova-compute[75257]:       <nova:owner>
Nov 14 02:08:41 user nova-compute[75257]:         <nova:user uuid="67156afa3d24427e90e99f944362ecfe">tempest-ServerActionsV293TestJSON-358377017-project-member</nova:user>
Nov 14 02:08:41 user nova-compute[75257]:         <nova:project uuid="91262b32dbc949beb98767d004ff9a73">tempest-ServerActionsV293TestJSON-358377017</nova:project>
Nov 14 02:08:41 user nova-compute[75257]:       </nova:owner>
Nov 14 02:08:41 user nova-compute[75257]:       <nova:ports>
Nov 14 02:08:41 user nova-compute[75257]:         <nova:port uuid="7c8790c5-8202-4e02-94e3-3581d766cc78">
Nov 14 02:08:41 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 02:08:41 user nova-compute[75257]:         </nova:port>
Nov 14 02:08:41 user nova-compute[75257]:       </nova:ports>
Nov 14 02:08:41 user nova-compute[75257]:     </nova:instance>
Nov 14 02:08:41 user nova-compute[75257]:   </metadata>
Nov 14 02:08:41 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:08:41 user nova-compute[75257]:     <system>
Nov 14 02:08:41 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:08:41 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:08:41 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:08:41 user nova-compute[75257]:       <entry name="serial">42d01836-ef5a-4dba-ab6a-49bfe7976879</entry>
Nov 14 02:08:41 user nova-compute[75257]:       <entry name="uuid">42d01836-ef5a-4dba-ab6a-49bfe7976879</entry>
Nov 14 02:08:41 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:08:41 user nova-compute[75257]:     </system>
Nov 14 02:08:41 user nova-compute[75257]:   </sysinfo>
Nov 14 02:08:41 user nova-compute[75257]:   <os>
Nov 14 02:08:41 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:08:41 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:08:41 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:08:41 user nova-compute[75257]:   </os>
Nov 14 02:08:41 user nova-compute[75257]:   <features>
Nov 14 02:08:41 user nova-compute[75257]:     <acpi/>
Nov 14 02:08:41 user nova-compute[75257]:     <apic/>
Nov 14 02:08:41 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:08:41 user nova-compute[75257]:   </features>
Nov 14 02:08:41 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:08:41 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:08:41 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:08:41 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:08:41 user nova-compute[75257]:   </clock>
Nov 14 02:08:41 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:08:41 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:08:41 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:08:41 user nova-compute[75257]:   </cpu>
Nov 14 02:08:41 user nova-compute[75257]:   <devices>
Nov 14 02:08:41 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:08:41 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:08:41 user nova-compute[75257]:       <source dev="/dev/sdc"/>
Nov 14 02:08:41 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:08:41 user nova-compute[75257]:       <serial>63a8b1e6-4579-48f6-8a4c-b75386826ce7</serial>
Nov 14 02:08:41 user nova-compute[75257]:     </disk>
Nov 14 02:08:41 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:08:41 user nova-compute[75257]:       <mac address="fa:16:3e:b4:04:3c"/>
Nov 14 02:08:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:08:41 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:08:41 user nova-compute[75257]:       <target dev="tap7c8790c5-82"/>
Nov 14 02:08:41 user nova-compute[75257]:     </interface>
Nov 14 02:08:41 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:08:41 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/42d01836-ef5a-4dba-ab6a-49bfe7976879/console.log" append="off"/>
Nov 14 02:08:41 user nova-compute[75257]:     </serial>
Nov 14 02:08:41 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:08:41 user nova-compute[75257]:     <video>
Nov 14 02:08:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:08:41 user nova-compute[75257]:     </video>
Nov 14 02:08:41 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:08:41 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:08:41 user nova-compute[75257]:     </rng>
Nov 14 02:08:41 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:08:41 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:08:41 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:08:41 user nova-compute[75257]:     </memballoon>
Nov 14 02:08:41 user nova-compute[75257]:   </devices>
Nov 14 02:08:41 user nova-compute[75257]: </domain>
Nov 14 02:08:41 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1126017660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-830117018',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgf2fXbCY9rsjb34KMUST8SMXto50nACORXEnnMj+K0J2fgBaFnj6x23XOrkc5PvkSbOH/DwnZ6aLyMOr4VrPPGI6VOba5H/JsmvGMycdDB8yWuFuzI/QXeNX4GuWC8IA==',key_name='tempest-keypair-586767792',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='91262b32dbc949beb98767d004ff9a73',ramdisk_id='',reservation_id='r-mljiki2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-358377017',owner_user_name='tempest-ServerActionsV293TestJSON-358377017-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67156afa3d24427e90e99f944362ecfe',uuid=42d01836-ef5a-4dba-ab6a-49bfe7976879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converting VIF {"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG os_vif [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a1b59c1-e2fb-5c3c-b94e-343e4d8d5574', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c8790c5-82, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c8790c5-82, col_values=(('qos', UUID('ff7ed5da-b5e7-4e3b-bc96-2b7fc34e0498')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c8790c5-82, col_values=(('external_ids', {'iface-id': '7c8790c5-8202-4e02-94e3-3581d766cc78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:04:3c', 'vm-uuid': '42d01836-ef5a-4dba-ab6a-49bfe7976879'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:41 user nova-compute[75257]: INFO os_vif [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82')
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] No VIF found with MAC fa:16:3e:b4:04:3c, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:08:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] No waiting events found dispatching network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:42 user nova-compute[75257]: WARNING nova.compute.manager [req-bfe51037-45cd-457a-916d-60798efd2665 req-824716e6-62fd-4dca-bd9b-77ceab2b23ed service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received unexpected event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 02:08:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:08:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance spawned successfully.
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:08:44 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 is timed out.
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:08:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Successfully detached device vdb from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 from the live domain config.
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiIdxeRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:44 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec99d7-b4ab-478c-815f-9e60eae6c119]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:08:44 user nova-compute[75257]: No targets found.
Nov 14 02:08:44 user nova-compute[75257]: iSNS:
Nov 14 02:08:44 user nova-compute[75257]: No targets found.
Nov 14 02:08:44 user nova-compute[75257]: STATIC:
Nov 14 02:08:44 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:08:44 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:44 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:44 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7
Nov 14 02:08:44 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:44 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:44 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901
Nov 14 02:08:44 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:44 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:44 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1
Nov 14 02:08:44 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:44 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:44 user nova-compute[75257]: FIRMWARE:
Nov 14 02:08:44 user nova-compute[75257]: No targets found.
Nov 14 02:08:44 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:08:44 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:08:44 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2907bb9e-04cb-4d9d-abba-f12e0c9c3abb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] No waiting events found dispatching network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:44 user nova-compute[75257]: WARNING nova.compute.manager [req-5563f112-397e-4699-befd-265e7f72cfaf req-6fc5da0d-23a1-4cda-8482-361da7c5b6ea service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received unexpected event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d76f67b-8a35-46d9-b48d-3cd047229984]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:44 user nova-compute[75257]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:44 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:44 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:44 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:44 user nova-compute[75257]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:44 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:44 user nova-compute[75257]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 (non-flash)
Nov 14 02:08:44 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c302dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0214f84b-aa73-4f72-b075-ea87a736f140]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG nova.objects.instance [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75257) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a12e134-4590-46a9-b9aa-38eccc92ccfe]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfc7b59-5b58-4c04-b599-27aa8a791e0f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e209d3-26c3-45f9-82a3-ed36c2bdfdcd]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-942e533d-ccb3-45c4-a6af-5c247a8d6d1f tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4335b115-b9a4-425f-95db-c483e037f85e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8d179a-50e7-402a-9d8f-787ce72be913]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1, portal: 172.16.0.220,3260]
Nov 14 02:08:45 user nova-compute[75257]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:45 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71282f04-b577-4513-8383-3f7510c0c6f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c554793-7eb5-4fa8-bff4-989a86e9e668]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] <== disconnect_volume: return (335ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG nova.objects.instance [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lazy-loading 'flavor' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-73b51061-2154-4d20-9fe9-038e471956e7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.949s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "interface-8de0ee5b-852a-4146-ba87-378181e1cfc4-07b9ece5-ed71-42e9-ae00-72829af206e8" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "interface-8de0ee5b-852a-4146-ba87-378181e1cfc4-07b9ece5-ed71-42e9-ae00-72829af206e8" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.objects.instance [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lazy-loading 'flavor' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053798230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053798230',id=8,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA==',key_name='tempest-keypair-1715447766',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe096d58b812473296c75ad5d3d5c924',ramdisk_id='',reservation_id='r-m0bnejek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1006457440',owner_user_name='tempest-TaggedAttachmentsTest-1006457440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ca1d05e84d74c1ab74521dcc91f3f38',uuid=8de0ee5b-852a-4146-ba87-378181e1cfc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converting VIF {"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface> {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface> {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Attempting to detach device tap07b9ece5-ed from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] detach device xml: <interface type="ethernet">
Nov 14 02:08:46 user nova-compute[75257]:   <mac address="fa:16:3e:35:dd:f5"/>
Nov 14 02:08:46 user nova-compute[75257]:   <model type="virtio"/>
Nov 14 02:08:46 user nova-compute[75257]:   <mtu size="1442"/>
Nov 14 02:08:46 user nova-compute[75257]:   <target dev="tap07b9ece5-ed"/>
Nov 14 02:08:46 user nova-compute[75257]: </interface>
Nov 14 02:08:46 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:46 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1326183-c4cb-40fa-a352-470e2c69cb05 is timed out.
Nov 14 02:08:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Successfully detached device vdb from instance a1326183-c4cb-40fa-a352-470e2c69cb05 from the live domain config.
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface> {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOJTkPEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:08:46 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 14 02:08:46 user nova-compute[75257]:   <name>instance-00000008</name>
Nov 14 02:08:46 user nova-compute[75257]:   <uuid>8de0ee5b-852a-4146-ba87-378181e1cfc4</uuid>
Nov 14 02:08:46 user nova-compute[75257]:   <metadata>
Nov 14 02:08:46 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:08:46 user nova-compute[75257]:   <nova:package version="0.0.0"/>
Nov 14 02:08:46 user nova-compute[75257]:   <nova:name>tempest-device-tagging-server-1053798230</nova:name>
Nov 14 02:08:46 user nova-compute[75257]:   <nova:creationTime>2023-11-14 02:08:11</nova:creationTime>
Nov 14 02:08:46 user nova-compute[75257]:   <nova:flavor name="m1.tiny">
Nov 14 02:08:46 user nova-compute[75257]:     <nova:memory>512</nova:memory>
Nov 14 02:08:46 user nova-compute[75257]:     <nova:disk>1</nova:disk>
Nov 14 02:08:46 user nova-compute[75257]:     <nova:swap>0</nova:swap>
Nov 14 02:08:46 user nova-compute[75257]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:08:46 user nova-compute[75257]:     <nova:vcpus>1</nova:vcpus>
Nov 14 02:08:46 user nova-compute[75257]:   </nova:flavor>
Nov 14 02:08:46 user nova-compute[75257]:   <nova:owner>
Nov 14 02:08:46 user nova-compute[75257]:     <nova:user uuid="3ca1d05e84d74c1ab74521dcc91f3f38">tempest-TaggedAttachmentsTest-1006457440-project-member</nova:user>
Nov 14 02:08:46 user nova-compute[75257]:     <nova:project uuid="fe096d58b812473296c75ad5d3d5c924">tempest-TaggedAttachmentsTest-1006457440</nova:project>
Nov 14 02:08:46 user nova-compute[75257]:   </nova:owner>
Nov 14 02:08:46 user nova-compute[75257]:   <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:08:46 user nova-compute[75257]:   <nova:ports>
Nov 14 02:08:46 user nova-compute[75257]:     <nova:port uuid="f0fa855e-494f-4fb7-9c5b-2022578e7a9e">
Nov 14 02:08:46 user nova-compute[75257]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:08:46 user nova-compute[75257]:     </nova:port>
Nov 14 02:08:46 user nova-compute[75257]:     <nova:port uuid="07b9ece5-ed71-42e9-ae00-72829af206e8">
Nov 14 02:08:46 user nova-compute[75257]:       <nova:ip type="fixed" address="10.10.10.254" ipVersion="4"/>
Nov 14 02:08:46 user nova-compute[75257]:     </nova:port>
Nov 14 02:08:46 user nova-compute[75257]:   </nova:ports>
Nov 14 02:08:46 user nova-compute[75257]: </nova:instance>
Nov 14 02:08:46 user nova-compute[75257]:   </metadata>
Nov 14 02:08:46 user nova-compute[75257]:   <memory unit='KiB'>524288</memory>
Nov 14 02:08:46 user nova-compute[75257]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 02:08:46 user nova-compute[75257]:   <vcpu placement='static'>1</vcpu>
Nov 14 02:08:46 user nova-compute[75257]:   <resource>
Nov 14 02:08:46 user nova-compute[75257]:     <partition>/machine</partition>
Nov 14 02:08:46 user nova-compute[75257]:   </resource>
Nov 14 02:08:46 user nova-compute[75257]:   <sysinfo type='smbios'>
Nov 14 02:08:46 user nova-compute[75257]:     <system>
Nov 14 02:08:46 user nova-compute[75257]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 02:08:46 user nova-compute[75257]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 02:08:46 user nova-compute[75257]:       <entry name='version'>0.0.0</entry>
Nov 14 02:08:46 user nova-compute[75257]:       <entry name='serial'>8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:08:46 user nova-compute[75257]:       <entry name='uuid'>8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:08:46 user nova-compute[75257]:       <entry name='family'>Virtual Machine</entry>
Nov 14 02:08:46 user nova-compute[75257]:     </system>
Nov 14 02:08:46 user nova-compute[75257]:   </sysinfo>
Nov 14 02:08:46 user nova-compute[75257]:   <os>
Nov 14 02:08:46 user nova-compute[75257]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 02:08:46 user nova-compute[75257]:     <boot dev='hd'/>
Nov 14 02:08:46 user nova-compute[75257]:     <smbios mode='sysinfo'/>
Nov 14 02:08:46 user nova-compute[75257]:   </os>
Nov 14 02:08:46 user nova-compute[75257]:   <features>
Nov 14 02:08:46 user nova-compute[75257]:     <acpi/>
Nov 14 02:08:46 user nova-compute[75257]:     <apic/>
Nov 14 02:08:46 user nova-compute[75257]:     <vmcoreinfo state='on'/>
Nov 14 02:08:46 user nova-compute[75257]:   </features>
Nov 14 02:08:46 user nova-compute[75257]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 02:08:46 user nova-compute[75257]:     <model fallback='forbid'>Nehalem</model>
Nov 14 02:08:46 user nova-compute[75257]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 02:08:46 user nova-compute[75257]:     <feature policy='require' name='vme'/>
Nov 14 02:08:46 user nova-compute[75257]:     <feature policy='require' name='x2apic'/>
Nov 14 02:08:46 user nova-compute[75257]:     <feature policy='require' name='hypervisor'/>
Nov 14 02:08:46 user nova-compute[75257]:   </cpu>
Nov 14 02:08:46 user nova-compute[75257]:   <clock offset='utc'>
Nov 14 02:08:46 user nova-compute[75257]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 02:08:46 user nova-compute[75257]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 02:08:46 user nova-compute[75257]:     <timer name='hpet' present='no'/>
Nov 14 02:08:46 user nova-compute[75257]:   </clock>
Nov 14 02:08:46 user nova-compute[75257]:   <on_poweroff>destroy</on_poweroff>
Nov 14 02:08:46 user nova-compute[75257]:   <on_reboot>restart</on_reboot>
Nov 14 02:08:46 user nova-compute[75257]:   <on_crash>destroy</on_crash>
Nov 14 02:08:46 user nova-compute[75257]:   <devices>
Nov 14 02:08:46 user nova-compute[75257]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 02:08:46 user nova-compute[75257]:     <disk type='file' device='disk'>
Nov 14 02:08:46 user nova-compute[75257]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 02:08:46 user nova-compute[75257]:       <source file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk' index='2'/>
Nov 14 02:08:46 user nova-compute[75257]:       <backingStore type='file' index='3'>
Nov 14 02:08:46 user nova-compute[75257]:         <format type='raw'/>
Nov 14 02:08:46 user nova-compute[75257]:         <source file='/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66'/>
Nov 14 02:08:46 user nova-compute[75257]:         <backingStore/>
Nov 14 02:08:46 user nova-compute[75257]:       </backingStore>
Nov 14 02:08:46 user nova-compute[75257]:       <target dev='vda' bus='virtio'/>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='virtio-disk0'/>
Nov 14 02:08:46 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </disk>
Nov 14 02:08:46 user nova-compute[75257]:     <disk type='file' device='cdrom'>
Nov 14 02:08:46 user nova-compute[75257]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 02:08:46 user nova-compute[75257]:       <source file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.config' index='1'/>
Nov 14 02:08:46 user nova-compute[75257]:       <backingStore/>
Nov 14 02:08:46 user nova-compute[75257]:       <target dev='hda' bus='ide'/>
Nov 14 02:08:46 user nova-compute[75257]:       <readonly/>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='ide0-0-0'/>
Nov 14 02:08:46 user nova-compute[75257]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </disk>
Nov 14 02:08:46 user nova-compute[75257]:     <controller type='usb' index='0' model='none'>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='usb'/>
Nov 14 02:08:46 user nova-compute[75257]:     </controller>
Nov 14 02:08:46 user nova-compute[75257]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='pci.0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </controller>
Nov 14 02:08:46 user nova-compute[75257]:     <controller type='ide' index='0'>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='ide'/>
Nov 14 02:08:46 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 02:08:46 user nova-compute[75257]:     </controller>
Nov 14 02:08:46 user nova-compute[75257]:     <interface type='ethernet'>
Nov 14 02:08:46 user nova-compute[75257]:       <mac address='fa:16:3e:a2:65:b2'/>
Nov 14 02:08:46 user nova-compute[75257]:       <target dev='tapf0fa855e-49'/>
Nov 14 02:08:46 user nova-compute[75257]:       <model type='virtio'/>
Nov 14 02:08:46 user nova-compute[75257]:       <mtu size='1442'/>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='net0'/>
Nov 14 02:08:46 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </interface>
Nov 14 02:08:46 user nova-compute[75257]:     <interface type='ethernet'>
Nov 14 02:08:46 user nova-compute[75257]:       <mac address='fa:16:3e:35:dd:f5'/>
Nov 14 02:08:46 user nova-compute[75257]:       <target dev='tap07b9ece5-ed'/>
Nov 14 02:08:46 user nova-compute[75257]:       <model type='virtio'/>
Nov 14 02:08:46 user nova-compute[75257]:       <mtu size='1442'/>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='net1'/>
Nov 14 02:08:46 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </interface>
Nov 14 02:08:46 user nova-compute[75257]:     <serial type='pty'>
Nov 14 02:08:46 user nova-compute[75257]:       <source path='/dev/pts/8'/>
Nov 14 02:08:46 user nova-compute[75257]:       <log file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log' append='off'/>
Nov 14 02:08:46 user nova-compute[75257]:       <target type='isa-serial' port='0'>
Nov 14 02:08:46 user nova-compute[75257]:         <model name='isa-serial'/>
Nov 14 02:08:46 user nova-compute[75257]:       </target>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='serial0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </serial>
Nov 14 02:08:46 user nova-compute[75257]:     <console type='pty' tty='/dev/pts/8'>
Nov 14 02:08:46 user nova-compute[75257]:       <source path='/dev/pts/8'/>
Nov 14 02:08:46 user nova-compute[75257]:       <log file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log' append='off'/>
Nov 14 02:08:46 user nova-compute[75257]:       <target type='serial' port='0'/>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='serial0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </console>
Nov 14 02:08:46 user nova-compute[75257]:     <input type='mouse' bus='ps2'>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='input0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </input>
Nov 14 02:08:46 user nova-compute[75257]:     <input type='keyboard' bus='ps2'>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='input1'/>
Nov 14 02:08:46 user nova-compute[75257]:     </input>
Nov 14 02:08:46 user nova-compute[75257]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 14 02:08:46 user nova-compute[75257]:       <listen type='address' address='0.0.0.0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </graphics>
Nov 14 02:08:46 user nova-compute[75257]:     <audio id='1' type='none'/>
Nov 14 02:08:46 user nova-compute[75257]:     <video>
Nov 14 02:08:46 user nova-compute[75257]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='video0'/>
Nov 14 02:08:46 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </video>
Nov 14 02:08:46 user nova-compute[75257]:     <memballoon model='virtio'>
Nov 14 02:08:46 user nova-compute[75257]:       <stats period='10'/>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='balloon0'/>
Nov 14 02:08:46 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </memballoon>
Nov 14 02:08:46 user nova-compute[75257]:     <rng model='virtio'>
Nov 14 02:08:46 user nova-compute[75257]:       <backend model='random'>/dev/urandom</backend>
Nov 14 02:08:46 user nova-compute[75257]:       <alias name='rng0'/>
Nov 14 02:08:46 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 02:08:46 user nova-compute[75257]:     </rng>
Nov 14 02:08:46 user nova-compute[75257]:   </devices>
Nov 14 02:08:46 user nova-compute[75257]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 02:08:46 user nova-compute[75257]:     <label>libvirt-8de0ee5b-852a-4146-ba87-378181e1cfc4</label>
Nov 14 02:08:46 user nova-compute[75257]:     <imagelabel>libvirt-8de0ee5b-852a-4146-ba87-378181e1cfc4</imagelabel>
Nov 14 02:08:46 user nova-compute[75257]:   </seclabel>
Nov 14 02:08:46 user nova-compute[75257]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 02:08:46 user nova-compute[75257]:     <label>+64055:+108</label>
Nov 14 02:08:46 user nova-compute[75257]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 02:08:46 user nova-compute[75257]:   </seclabel>
Nov 14 02:08:46 user nova-compute[75257]: </domain>
Nov 14 02:08:46 user nova-compute[75257]:  {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 02:08:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Successfully detached device tap07b9ece5-ed from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 from the persistent domain config.
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] (1/8): Attempting to detach device tap07b9ece5-ed with device alias net1 from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] detach device xml: <interface type="ethernet">
Nov 14 02:08:46 user nova-compute[75257]:   <mac address="fa:16:3e:35:dd:f5"/>
Nov 14 02:08:46 user nova-compute[75257]:   <model type="virtio"/>
Nov 14 02:08:46 user nova-compute[75257]:   <mtu size="1442"/>
Nov 14 02:08:46 user nova-compute[75257]:   <target dev="tap07b9ece5-ed"/>
Nov 14 02:08:46 user nova-compute[75257]: </interface>
Nov 14 02:08:46 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9947e7ef-2f01-43fb-b719-a55b50304511]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:08:46 user nova-compute[75257]: No targets found.
Nov 14 02:08:46 user nova-compute[75257]: iSNS:
Nov 14 02:08:46 user nova-compute[75257]: No targets found.
Nov 14 02:08:46 user nova-compute[75257]: STATIC:
Nov 14 02:08:46 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:08:46 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:46 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:46 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7
Nov 14 02:08:46 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:46 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:46 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901
Nov 14 02:08:46 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:08:46 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:08:46 user nova-compute[75257]: FIRMWARE:
Nov 14 02:08:46 user nova-compute[75257]: No targets found.
Nov 14 02:08:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:08:46 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:08:46 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7831194f-07c4-4f6e-b185-0cf77e9abc8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b28443-a87d-4a84-ae19-7d0d3ca2a1f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:46 user nova-compute[75257]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:46 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 (non-flash)
Nov 14 02:08:46 user nova-compute[75257]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:08:46 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:08:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c303eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901'): ({'sdf'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Removing single pathed devices sdf {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[26159ecf-2e92-45c2-b1b2-8f00003e5e54]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d536a38b-fd7f-4575-80f0-a4ad7d33445d]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Flushing IO for device /dev/sdf {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13ca764-0a3d-488f-bce2-20da233d9e01]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[24386e6d-ae4f-49c1-a51f-a8733b267ea0]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adeec23-a24a-481a-a7e7-5a8d5add000a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b03a32-29e9-4142-ad66-b5b0bdbd418e]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901, portal: 172.16.0.220,3260]
Nov 14 02:08:46 user nova-compute[75257]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901, portal: 172.16.0.220,3260] successful.
Nov 14 02:08:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Start waiting for the detach event from libvirt for device tap07b9ece5-ed with device alias net1 for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c24d19d-34aa-4f62-886b-3b261a4af901 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e4e0b-3394-40d1-8f3d-390c9846293f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] <== disconnect_volume: return (325ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-unplugged-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-unplugged-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:46 user nova-compute[75257]: WARNING nova.compute.manager [req-b9c075c4-0508-4109-90a6-c6f14f5e9f22 req-376b1423-f2d8-4299-b1dd-e85cd54c0d7a service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-unplugged-07b9ece5-ed71-42e9-ae00-72829af206e8 for instance with vm_state active and task_state None.
Nov 14 02:08:47 user nova-compute[75257]: DEBUG nova.objects.instance [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lazy-loading 'flavor' on Instance uuid a1326183-c4cb-40fa-a352-470e2c69cb05 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:08:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-65642c5b-5811-4187-bdd0-42019739fcdd tempest-VolumesAssistedSnapshotsTest-1117892149 tempest-VolumesAssistedSnapshotsTest-1117892149-project-admin] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:48 user nova-compute[75257]: DEBUG nova.compute.manager [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-plugged-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:08:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:08:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:08:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:08:48 user nova-compute[75257]: DEBUG nova.compute.manager [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-plugged-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:08:48 user nova-compute[75257]: WARNING nova.compute.manager [req-11bd2784-155f-45b9-bea3-263e98910ec1 req-6a934d6c-4f0a-446c-8831-d8775e5b7644 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-plugged-07b9ece5-ed71-42e9-ae00-72829af206e8 for instance with vm_state active and task_state None.
Nov 14 02:08:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:08:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:00 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:09:00 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:09:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:09:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Updating instance_info_cache with network_info: [{"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:09:03 user nova-compute[75257]: INFO nova.compute.claims [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Claim successful on node user
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:09:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:09:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG nova.policy [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e4dbe6bba744f4cabba17fcbea21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4120a890b64ac9abb385f0ba8d3447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:09:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Creating image(s)
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "/opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "/opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "/opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Successfully created port: cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.492s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:05 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:05 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7590MB free_disk=25.455280303955078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk 1073741824" returned: 0 in 0.053s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.550s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 71a9d20f-e79b-4716-abf8-a15330742167 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2f9df98c-7814-419d-8821-d8c571972f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance fd62b270-19d7-45e5-bd66-a94c384050bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a1326183-c4cb-40fa-a352-470e2c69cb05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b950c25e-2910-4de3-a9fc-30e4091dfe19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Cannot resize image /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Ensure instance console log exists: /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Successfully updated port: cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "refresh_cache-907693ff-78a5-4fd7-8f75-c70f6186cbbe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquired lock "refresh_cache-907693ff-78a5-4fd7-8f75-c70f6186cbbe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received event network-changed-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Refreshing instance network info cache due to event network-changed-cf51ac46-0972-4e4e-9fea-bc81307c13f9. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] Acquiring lock "refresh_cache-907693ff-78a5-4fd7-8f75-c70f6186cbbe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Updating instance_info_cache with network_info: [{"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Releasing lock "refresh_cache-907693ff-78a5-4fd7-8f75-c70f6186cbbe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Instance network_info: |[{"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] Acquired lock "refresh_cache-907693ff-78a5-4fd7-8f75-c70f6186cbbe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Refreshing network info cache for port cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Start _get_guest_xml network_info=[{"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:09:06 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:06 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-467865777',display_name='tempest-VolumesAdminNegativeTest-server-467865777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-467865777',id=13,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4120a890b64ac9abb385f0ba8d3447',ramdisk_id='',reservation_id='r-69dh4nws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1630669709',owner_user_name='tempest-VolumesAdminNegativeTest-1630669709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:04Z,user_data=None,user_id='9e4dbe6bba744f4cabba17fcbea21c64',uuid=907693ff-78a5-4fd7-8f75-c70f6186cbbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converting VIF {"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=cf51ac46-0972-4e4e-9fea-bc81307c13f9,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf51ac46-09') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lazy-loading 'pci_devices' on Instance uuid 907693ff-78a5-4fd7-8f75-c70f6186cbbe {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:09:06 user nova-compute[75257]:   <uuid>907693ff-78a5-4fd7-8f75-c70f6186cbbe</uuid>
Nov 14 02:09:06 user nova-compute[75257]:   <name>instance-0000000d</name>
Nov 14 02:09:06 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:09:06 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:09:06 user nova-compute[75257]:   <metadata>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:06 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:09:06 user nova-compute[75257]:       <nova:name>tempest-VolumesAdminNegativeTest-server-467865777</nova:name>
Nov 14 02:09:06 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:09:06</nova:creationTime>
Nov 14 02:09:06 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:09:06 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:09:06 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:09:06 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:09:06 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:06 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:06 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:09:06 user nova-compute[75257]:       <nova:owner>
Nov 14 02:09:06 user nova-compute[75257]:         <nova:user uuid="9e4dbe6bba744f4cabba17fcbea21c64">tempest-VolumesAdminNegativeTest-1630669709-project-member</nova:user>
Nov 14 02:09:06 user nova-compute[75257]:         <nova:project uuid="2b4120a890b64ac9abb385f0ba8d3447">tempest-VolumesAdminNegativeTest-1630669709</nova:project>
Nov 14 02:09:06 user nova-compute[75257]:       </nova:owner>
Nov 14 02:09:06 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:06 user nova-compute[75257]:       <nova:ports>
Nov 14 02:09:06 user nova-compute[75257]:         <nova:port uuid="cf51ac46-0972-4e4e-9fea-bc81307c13f9">
Nov 14 02:09:06 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 02:09:06 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:06 user nova-compute[75257]:       </nova:ports>
Nov 14 02:09:06 user nova-compute[75257]:     </nova:instance>
Nov 14 02:09:06 user nova-compute[75257]:   </metadata>
Nov 14 02:09:06 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:09:06 user nova-compute[75257]:     <system>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name="serial">907693ff-78a5-4fd7-8f75-c70f6186cbbe</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name="uuid">907693ff-78a5-4fd7-8f75-c70f6186cbbe</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:09:06 user nova-compute[75257]:     </system>
Nov 14 02:09:06 user nova-compute[75257]:   </sysinfo>
Nov 14 02:09:06 user nova-compute[75257]:   <os>
Nov 14 02:09:06 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:09:06 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:09:06 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:09:06 user nova-compute[75257]:   </os>
Nov 14 02:09:06 user nova-compute[75257]:   <features>
Nov 14 02:09:06 user nova-compute[75257]:     <acpi/>
Nov 14 02:09:06 user nova-compute[75257]:     <apic/>
Nov 14 02:09:06 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:09:06 user nova-compute[75257]:   </features>
Nov 14 02:09:06 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:09:06 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:09:06 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:09:06 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:09:06 user nova-compute[75257]:   </clock>
Nov 14 02:09:06 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:09:06 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:09:06 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:09:06 user nova-compute[75257]:   </cpu>
Nov 14 02:09:06 user nova-compute[75257]:   <devices>
Nov 14 02:09:06 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:09:06 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:09:06 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk"/>
Nov 14 02:09:06 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:09:06 user nova-compute[75257]:     </disk>
Nov 14 02:09:06 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:06 user nova-compute[75257]:       <mac address="fa:16:3e:08:d0:6e"/>
Nov 14 02:09:06 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:06 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:06 user nova-compute[75257]:       <target dev="tapcf51ac46-09"/>
Nov 14 02:09:06 user nova-compute[75257]:     </interface>
Nov 14 02:09:06 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:09:06 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/console.log" append="off"/>
Nov 14 02:09:06 user nova-compute[75257]:     </serial>
Nov 14 02:09:06 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:09:06 user nova-compute[75257]:     <video>
Nov 14 02:09:06 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:06 user nova-compute[75257]:     </video>
Nov 14 02:09:06 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:09:06 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:09:06 user nova-compute[75257]:     </rng>
Nov 14 02:09:06 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:09:06 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:09:06 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:09:06 user nova-compute[75257]:     </memballoon>
Nov 14 02:09:06 user nova-compute[75257]:   </devices>
Nov 14 02:09:06 user nova-compute[75257]: </domain>
Nov 14 02:09:06 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-467865777',display_name='tempest-VolumesAdminNegativeTest-server-467865777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-467865777',id=13,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b4120a890b64ac9abb385f0ba8d3447',ramdisk_id='',reservation_id='r-69dh4nws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1630669709',owner_user_name='tempest-VolumesAdminNegativeTest-1630669709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:04Z,user_data=None,user_id='9e4dbe6bba744f4cabba17fcbea21c64',uuid=907693ff-78a5-4fd7-8f75-c70f6186cbbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converting VIF {"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=cf51ac46-0972-4e4e-9fea-bc81307c13f9,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf51ac46-09') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG os_vif [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=cf51ac46-0972-4e4e-9fea-bc81307c13f9,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf51ac46-09') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87f02e55-820b-513c-ade4-5d33d5426f30', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf51ac46-09, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf51ac46-09, col_values=(('qos', UUID('9cc0b36b-b53b-4b38-aecc-9cde115cd9e9')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf51ac46-09, col_values=(('external_ids', {'iface-id': 'cf51ac46-0972-4e4e-9fea-bc81307c13f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:d0:6e', 'vm-uuid': '907693ff-78a5-4fd7-8f75-c70f6186cbbe'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: INFO os_vif [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=cf51ac46-0972-4e4e-9fea-bc81307c13f9,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf51ac46-09')
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] No VIF found with MAC fa:16:3e:08:d0:6e, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Updated VIF entry in instance network info cache for port cf51ac46-0972-4e4e-9fea-bc81307c13f9. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Updating instance_info_cache with network_info: [{"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-02a5ab12-6d2e-4483-9adc-aea0ccb6042a req-b3a0bdb1-c733-4fe2-a0d4-c914540fc936 service nova] Releasing lock "refresh_cache-907693ff-78a5-4fd7-8f75-c70f6186cbbe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:06 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Waiting for libvirt event about the detach of device tap07b9ece5-ed with device alias net1 from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 is timed out.
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface> {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 14 02:09:06 user nova-compute[75257]:   <name>instance-00000008</name>
Nov 14 02:09:06 user nova-compute[75257]:   <uuid>8de0ee5b-852a-4146-ba87-378181e1cfc4</uuid>
Nov 14 02:09:06 user nova-compute[75257]:   <metadata>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:06 user nova-compute[75257]:   <nova:package version="0.0.0"/>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:name>tempest-device-tagging-server-1053798230</nova:name>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:creationTime>2023-11-14 02:08:11</nova:creationTime>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:flavor name="m1.tiny">
Nov 14 02:09:06 user nova-compute[75257]:     <nova:memory>512</nova:memory>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:disk>1</nova:disk>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:swap>0</nova:swap>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:06 user nova-compute[75257]:   </nova:flavor>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:owner>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:user uuid="3ca1d05e84d74c1ab74521dcc91f3f38">tempest-TaggedAttachmentsTest-1006457440-project-member</nova:user>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:project uuid="fe096d58b812473296c75ad5d3d5c924">tempest-TaggedAttachmentsTest-1006457440</nova:project>
Nov 14 02:09:06 user nova-compute[75257]:   </nova:owner>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:ports>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:port uuid="f0fa855e-494f-4fb7-9c5b-2022578e7a9e">
Nov 14 02:09:06 user nova-compute[75257]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:09:06 user nova-compute[75257]:     </nova:port>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:port uuid="07b9ece5-ed71-42e9-ae00-72829af206e8">
Nov 14 02:09:06 user nova-compute[75257]:       <nova:ip type="fixed" address="10.10.10.254" ipVersion="4"/>
Nov 14 02:09:06 user nova-compute[75257]:     </nova:port>
Nov 14 02:09:06 user nova-compute[75257]:   </nova:ports>
Nov 14 02:09:06 user nova-compute[75257]: </nova:instance>
Nov 14 02:09:06 user nova-compute[75257]:   </metadata>
Nov 14 02:09:06 user nova-compute[75257]:   <memory unit='KiB'>524288</memory>
Nov 14 02:09:06 user nova-compute[75257]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 02:09:06 user nova-compute[75257]:   <vcpu placement='static'>1</vcpu>
Nov 14 02:09:06 user nova-compute[75257]:   <resource>
Nov 14 02:09:06 user nova-compute[75257]:     <partition>/machine</partition>
Nov 14 02:09:06 user nova-compute[75257]:   </resource>
Nov 14 02:09:06 user nova-compute[75257]:   <sysinfo type='smbios'>
Nov 14 02:09:06 user nova-compute[75257]:     <system>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name='version'>0.0.0</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name='serial'>8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name='uuid'>8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:09:06 user nova-compute[75257]:       <entry name='family'>Virtual Machine</entry>
Nov 14 02:09:06 user nova-compute[75257]:     </system>
Nov 14 02:09:06 user nova-compute[75257]:   </sysinfo>
Nov 14 02:09:06 user nova-compute[75257]:   <os>
Nov 14 02:09:06 user nova-compute[75257]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 02:09:06 user nova-compute[75257]:     <boot dev='hd'/>
Nov 14 02:09:06 user nova-compute[75257]:     <smbios mode='sysinfo'/>
Nov 14 02:09:06 user nova-compute[75257]:   </os>
Nov 14 02:09:06 user nova-compute[75257]:   <features>
Nov 14 02:09:06 user nova-compute[75257]:     <acpi/>
Nov 14 02:09:06 user nova-compute[75257]:     <apic/>
Nov 14 02:09:06 user nova-compute[75257]:     <vmcoreinfo state='on'/>
Nov 14 02:09:06 user nova-compute[75257]:   </features>
Nov 14 02:09:06 user nova-compute[75257]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 02:09:06 user nova-compute[75257]:     <model fallback='forbid'>Nehalem</model>
Nov 14 02:09:06 user nova-compute[75257]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 02:09:06 user nova-compute[75257]:     <feature policy='require' name='vme'/>
Nov 14 02:09:06 user nova-compute[75257]:     <feature policy='require' name='x2apic'/>
Nov 14 02:09:06 user nova-compute[75257]:     <feature policy='require' name='hypervisor'/>
Nov 14 02:09:06 user nova-compute[75257]:   </cpu>
Nov 14 02:09:06 user nova-compute[75257]:   <clock offset='utc'>
Nov 14 02:09:06 user nova-compute[75257]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 02:09:06 user nova-compute[75257]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 02:09:06 user nova-compute[75257]:     <timer name='hpet' present='no'/>
Nov 14 02:09:06 user nova-compute[75257]:   </clock>
Nov 14 02:09:06 user nova-compute[75257]:   <on_poweroff>destroy</on_poweroff>
Nov 14 02:09:06 user nova-compute[75257]:   <on_reboot>restart</on_reboot>
Nov 14 02:09:06 user nova-compute[75257]:   <on_crash>destroy</on_crash>
Nov 14 02:09:06 user nova-compute[75257]:   <devices>
Nov 14 02:09:06 user nova-compute[75257]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 02:09:06 user nova-compute[75257]:     <disk type='file' device='disk'>
Nov 14 02:09:06 user nova-compute[75257]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 02:09:06 user nova-compute[75257]:       <source file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk' index='2'/>
Nov 14 02:09:06 user nova-compute[75257]:       <backingStore type='file' index='3'>
Nov 14 02:09:06 user nova-compute[75257]:         <format type='raw'/>
Nov 14 02:09:06 user nova-compute[75257]:         <source file='/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66'/>
Nov 14 02:09:06 user nova-compute[75257]:         <backingStore/>
Nov 14 02:09:06 user nova-compute[75257]:       </backingStore>
Nov 14 02:09:06 user nova-compute[75257]:       <target dev='vda' bus='virtio'/>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='virtio-disk0'/>
Nov 14 02:09:06 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </disk>
Nov 14 02:09:06 user nova-compute[75257]:     <disk type='file' device='cdrom'>
Nov 14 02:09:06 user nova-compute[75257]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 02:09:06 user nova-compute[75257]:       <source file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.config' index='1'/>
Nov 14 02:09:06 user nova-compute[75257]:       <backingStore/>
Nov 14 02:09:06 user nova-compute[75257]:       <target dev='hda' bus='ide'/>
Nov 14 02:09:06 user nova-compute[75257]:       <readonly/>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='ide0-0-0'/>
Nov 14 02:09:06 user nova-compute[75257]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </disk>
Nov 14 02:09:06 user nova-compute[75257]:     <controller type='usb' index='0' model='none'>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='usb'/>
Nov 14 02:09:06 user nova-compute[75257]:     </controller>
Nov 14 02:09:06 user nova-compute[75257]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='pci.0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </controller>
Nov 14 02:09:06 user nova-compute[75257]:     <controller type='ide' index='0'>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='ide'/>
Nov 14 02:09:06 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 02:09:06 user nova-compute[75257]:     </controller>
Nov 14 02:09:06 user nova-compute[75257]:     <interface type='ethernet'>
Nov 14 02:09:06 user nova-compute[75257]:       <mac address='fa:16:3e:a2:65:b2'/>
Nov 14 02:09:06 user nova-compute[75257]:       <target dev='tapf0fa855e-49'/>
Nov 14 02:09:06 user nova-compute[75257]:       <model type='virtio'/>
Nov 14 02:09:06 user nova-compute[75257]:       <mtu size='1442'/>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='net0'/>
Nov 14 02:09:06 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </interface>
Nov 14 02:09:06 user nova-compute[75257]:     <serial type='pty'>
Nov 14 02:09:06 user nova-compute[75257]:       <source path='/dev/pts/8'/>
Nov 14 02:09:06 user nova-compute[75257]:       <log file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log' append='off'/>
Nov 14 02:09:06 user nova-compute[75257]:       <target type='isa-serial' port='0'>
Nov 14 02:09:06 user nova-compute[75257]:         <model name='isa-serial'/>
Nov 14 02:09:06 user nova-compute[75257]:       </target>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='serial0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </serial>
Nov 14 02:09:06 user nova-compute[75257]:     <console type='pty' tty='/dev/pts/8'>
Nov 14 02:09:06 user nova-compute[75257]:       <source path='/dev/pts/8'/>
Nov 14 02:09:06 user nova-compute[75257]:       <log file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log' append='off'/>
Nov 14 02:09:06 user nova-compute[75257]:       <target type='serial' port='0'/>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='serial0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </console>
Nov 14 02:09:06 user nova-compute[75257]:     <input type='mouse' bus='ps2'>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='input0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </input>
Nov 14 02:09:06 user nova-compute[75257]:     <input type='keyboard' bus='ps2'>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='input1'/>
Nov 14 02:09:06 user nova-compute[75257]:     </input>
Nov 14 02:09:06 user nova-compute[75257]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 14 02:09:06 user nova-compute[75257]:       <listen type='address' address='0.0.0.0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </graphics>
Nov 14 02:09:06 user nova-compute[75257]:     <audio id='1' type='none'/>
Nov 14 02:09:06 user nova-compute[75257]:     <video>
Nov 14 02:09:06 user nova-compute[75257]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='video0'/>
Nov 14 02:09:06 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </video>
Nov 14 02:09:06 user nova-compute[75257]:     <memballoon model='virtio'>
Nov 14 02:09:06 user nova-compute[75257]:       <stats period='10'/>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='balloon0'/>
Nov 14 02:09:06 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </memballoon>
Nov 14 02:09:06 user nova-compute[75257]:     <rng model='virtio'>
Nov 14 02:09:06 user nova-compute[75257]:       <backend model='random'>/dev/urandom</backend>
Nov 14 02:09:06 user nova-compute[75257]:       <alias name='rng0'/>
Nov 14 02:09:06 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 02:09:06 user nova-compute[75257]:     </rng>
Nov 14 02:09:06 user nova-compute[75257]:   </devices>
Nov 14 02:09:06 user nova-compute[75257]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 02:09:06 user nova-compute[75257]:     <label>libvirt-8de0ee5b-852a-4146-ba87-378181e1cfc4</label>
Nov 14 02:09:06 user nova-compute[75257]:     <imagelabel>libvirt-8de0ee5b-852a-4146-ba87-378181e1cfc4</imagelabel>
Nov 14 02:09:06 user nova-compute[75257]:   </seclabel>
Nov 14 02:09:06 user nova-compute[75257]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 02:09:06 user nova-compute[75257]:     <label>+64055:+108</label>
Nov 14 02:09:06 user nova-compute[75257]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 02:09:06 user nova-compute[75257]:   </seclabel>
Nov 14 02:09:06 user nova-compute[75257]: </domain>
Nov 14 02:09:06 user nova-compute[75257]:  {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 02:09:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Successfully detached device tap07b9ece5-ed from instance 8de0ee5b-852a-4146-ba87-378181e1cfc4 from the live domain config.
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053798230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053798230',id=8,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA==',key_name='tempest-keypair-1715447766',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe096d58b812473296c75ad5d3d5c924',ramdisk_id='',reservation_id='r-m0bnejek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1006457440',owner_user_name='tempest-TaggedAttachmentsTest-1006457440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ca1d05e84d74c1ab74521dcc91f3f38',uuid=8de0ee5b-852a-4146-ba87-378181e1cfc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converting VIF {"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG os_vif [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07b9ece5-ed, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd8264dc-7b70-443d-ac44-0a6c300886ec) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:06 user nova-compute[75257]: INFO os_vif [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed')
Nov 14 02:09:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:06 user nova-compute[75257]:   <nova:package version="0.0.0"/>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:name>tempest-device-tagging-server-1053798230</nova:name>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:creationTime>2023-11-14 02:09:06</nova:creationTime>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:flavor name="m1.tiny">
Nov 14 02:09:06 user nova-compute[75257]:     <nova:memory>512</nova:memory>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:disk>1</nova:disk>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:swap>0</nova:swap>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:06 user nova-compute[75257]:   </nova:flavor>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:owner>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:user uuid="3ca1d05e84d74c1ab74521dcc91f3f38">tempest-TaggedAttachmentsTest-1006457440-project-member</nova:user>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:project uuid="fe096d58b812473296c75ad5d3d5c924">tempest-TaggedAttachmentsTest-1006457440</nova:project>
Nov 14 02:09:06 user nova-compute[75257]:   </nova:owner>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:06 user nova-compute[75257]:   <nova:ports>
Nov 14 02:09:06 user nova-compute[75257]:     <nova:port uuid="f0fa855e-494f-4fb7-9c5b-2022578e7a9e">
Nov 14 02:09:06 user nova-compute[75257]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:09:06 user nova-compute[75257]:     </nova:port>
Nov 14 02:09:06 user nova-compute[75257]:   </nova:ports>
Nov 14 02:09:06 user nova-compute[75257]: </nova:instance>
Nov 14 02:09:06 user nova-compute[75257]:  {{(pid=75257) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 02:09:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquired lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:09:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received event network-vif-plugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] Acquiring lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] No waiting events found dispatching network-vif-plugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:08 user nova-compute[75257]: WARNING nova.compute.manager [req-19bd93d2-c4c3-4229-b3d9-32bfd70467e1 req-a8c4fde3-abdf-4840-bef0-92d59b910cb9 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received unexpected event network-vif-plugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance with vm_state building and task_state spawning.
Nov 14 02:09:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-deleted-07b9ece5-ed71-42e9-ae00-72829af206e8 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:08 user nova-compute[75257]: INFO nova.compute.manager [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Neutron deleted interface 07b9ece5-ed71-42e9-ae00-72829af206e8; detaching it from the instance and deleting it from the info cache
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.network.neutron [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updating instance_info_cache with network_info: [{"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.objects.instance [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Lazy-loading 'system_metadata' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:08 user nova-compute[75257]: INFO nova.network.neutron [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Port 07b9ece5-ed71-42e9-ae00-72829af206e8 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updating instance_info_cache with network_info: [{"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Releasing lock "refresh_cache-8de0ee5b-852a-4146-ba87-378181e1cfc4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.objects.instance [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Lazy-loading 'flavor' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4430cc49-cca2-479d-943f-f392d6f822c7 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "interface-8de0ee5b-852a-4146-ba87-378181e1cfc4-07b9ece5-ed71-42e9-ae00-72829af206e8" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.872s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.objects.base [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Object Instance<8de0ee5b-852a-4146-ba87-378181e1cfc4> lazy-loaded attributes: system_metadata,flavor {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053798230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053798230',id=8,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA==',key_name='tempest-keypair-1715447766',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe096d58b812473296c75ad5d3d5c924',ramdisk_id='',reservation_id='r-m0bnejek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1006457440',owner_user_name='tempest-TaggedAttachmentsTest-1006457440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ca1d05e84d74c1ab74521dcc91f3f38',uuid=8de0ee5b-852a-4146-ba87-378181e1cfc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Converting VIF {"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface> {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 14 02:09:08 user nova-compute[75257]:   <name>instance-00000008</name>
Nov 14 02:09:08 user nova-compute[75257]:   <uuid>8de0ee5b-852a-4146-ba87-378181e1cfc4</uuid>
Nov 14 02:09:08 user nova-compute[75257]:   <metadata>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:08 user nova-compute[75257]:   <nova:package version="0.0.0"/>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:name>tempest-device-tagging-server-1053798230</nova:name>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:creationTime>2023-11-14 02:09:06</nova:creationTime>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:flavor name="m1.tiny">
Nov 14 02:09:08 user nova-compute[75257]:     <nova:memory>512</nova:memory>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:disk>1</nova:disk>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:swap>0</nova:swap>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:08 user nova-compute[75257]:   </nova:flavor>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:owner>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:user uuid="3ca1d05e84d74c1ab74521dcc91f3f38">tempest-TaggedAttachmentsTest-1006457440-project-member</nova:user>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:project uuid="fe096d58b812473296c75ad5d3d5c924">tempest-TaggedAttachmentsTest-1006457440</nova:project>
Nov 14 02:09:08 user nova-compute[75257]:   </nova:owner>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:ports>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:port uuid="f0fa855e-494f-4fb7-9c5b-2022578e7a9e">
Nov 14 02:09:08 user nova-compute[75257]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:09:08 user nova-compute[75257]:     </nova:port>
Nov 14 02:09:08 user nova-compute[75257]:   </nova:ports>
Nov 14 02:09:08 user nova-compute[75257]: </nova:instance>
Nov 14 02:09:08 user nova-compute[75257]:   </metadata>
Nov 14 02:09:08 user nova-compute[75257]:   <memory unit='KiB'>524288</memory>
Nov 14 02:09:08 user nova-compute[75257]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 02:09:08 user nova-compute[75257]:   <vcpu placement='static'>1</vcpu>
Nov 14 02:09:08 user nova-compute[75257]:   <resource>
Nov 14 02:09:08 user nova-compute[75257]:     <partition>/machine</partition>
Nov 14 02:09:08 user nova-compute[75257]:   </resource>
Nov 14 02:09:08 user nova-compute[75257]:   <sysinfo type='smbios'>
Nov 14 02:09:08 user nova-compute[75257]:     <system>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='version'>0.0.0</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='serial'>8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='uuid'>8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='family'>Virtual Machine</entry>
Nov 14 02:09:08 user nova-compute[75257]:     </system>
Nov 14 02:09:08 user nova-compute[75257]:   </sysinfo>
Nov 14 02:09:08 user nova-compute[75257]:   <os>
Nov 14 02:09:08 user nova-compute[75257]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 02:09:08 user nova-compute[75257]:     <boot dev='hd'/>
Nov 14 02:09:08 user nova-compute[75257]:     <smbios mode='sysinfo'/>
Nov 14 02:09:08 user nova-compute[75257]:   </os>
Nov 14 02:09:08 user nova-compute[75257]:   <features>
Nov 14 02:09:08 user nova-compute[75257]:     <acpi/>
Nov 14 02:09:08 user nova-compute[75257]:     <apic/>
Nov 14 02:09:08 user nova-compute[75257]:     <vmcoreinfo state='on'/>
Nov 14 02:09:08 user nova-compute[75257]:   </features>
Nov 14 02:09:08 user nova-compute[75257]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 02:09:08 user nova-compute[75257]:     <model fallback='forbid'>Nehalem</model>
Nov 14 02:09:08 user nova-compute[75257]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 02:09:08 user nova-compute[75257]:     <feature policy='require' name='vme'/>
Nov 14 02:09:08 user nova-compute[75257]:     <feature policy='require' name='x2apic'/>
Nov 14 02:09:08 user nova-compute[75257]:     <feature policy='require' name='hypervisor'/>
Nov 14 02:09:08 user nova-compute[75257]:   </cpu>
Nov 14 02:09:08 user nova-compute[75257]:   <clock offset='utc'>
Nov 14 02:09:08 user nova-compute[75257]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 02:09:08 user nova-compute[75257]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 02:09:08 user nova-compute[75257]:     <timer name='hpet' present='no'/>
Nov 14 02:09:08 user nova-compute[75257]:   </clock>
Nov 14 02:09:08 user nova-compute[75257]:   <on_poweroff>destroy</on_poweroff>
Nov 14 02:09:08 user nova-compute[75257]:   <on_reboot>restart</on_reboot>
Nov 14 02:09:08 user nova-compute[75257]:   <on_crash>destroy</on_crash>
Nov 14 02:09:08 user nova-compute[75257]:   <devices>
Nov 14 02:09:08 user nova-compute[75257]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 02:09:08 user nova-compute[75257]:     <disk type='file' device='disk'>
Nov 14 02:09:08 user nova-compute[75257]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 02:09:08 user nova-compute[75257]:       <source file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk' index='2'/>
Nov 14 02:09:08 user nova-compute[75257]:       <backingStore type='file' index='3'>
Nov 14 02:09:08 user nova-compute[75257]:         <format type='raw'/>
Nov 14 02:09:08 user nova-compute[75257]:         <source file='/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66'/>
Nov 14 02:09:08 user nova-compute[75257]:         <backingStore/>
Nov 14 02:09:08 user nova-compute[75257]:       </backingStore>
Nov 14 02:09:08 user nova-compute[75257]:       <target dev='vda' bus='virtio'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='virtio-disk0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </disk>
Nov 14 02:09:08 user nova-compute[75257]:     <disk type='file' device='cdrom'>
Nov 14 02:09:08 user nova-compute[75257]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 02:09:08 user nova-compute[75257]:       <source file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.config' index='1'/>
Nov 14 02:09:08 user nova-compute[75257]:       <backingStore/>
Nov 14 02:09:08 user nova-compute[75257]:       <target dev='hda' bus='ide'/>
Nov 14 02:09:08 user nova-compute[75257]:       <readonly/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='ide0-0-0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </disk>
Nov 14 02:09:08 user nova-compute[75257]:     <controller type='usb' index='0' model='none'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='usb'/>
Nov 14 02:09:08 user nova-compute[75257]:     </controller>
Nov 14 02:09:08 user nova-compute[75257]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='pci.0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </controller>
Nov 14 02:09:08 user nova-compute[75257]:     <controller type='ide' index='0'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='ide'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 02:09:08 user nova-compute[75257]:     </controller>
Nov 14 02:09:08 user nova-compute[75257]:     <interface type='ethernet'>
Nov 14 02:09:08 user nova-compute[75257]:       <mac address='fa:16:3e:a2:65:b2'/>
Nov 14 02:09:08 user nova-compute[75257]:       <target dev='tapf0fa855e-49'/>
Nov 14 02:09:08 user nova-compute[75257]:       <model type='virtio'/>
Nov 14 02:09:08 user nova-compute[75257]:       <mtu size='1442'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='net0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </interface>
Nov 14 02:09:08 user nova-compute[75257]:     <serial type='pty'>
Nov 14 02:09:08 user nova-compute[75257]:       <source path='/dev/pts/8'/>
Nov 14 02:09:08 user nova-compute[75257]:       <log file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log' append='off'/>
Nov 14 02:09:08 user nova-compute[75257]:       <target type='isa-serial' port='0'>
Nov 14 02:09:08 user nova-compute[75257]:         <model name='isa-serial'/>
Nov 14 02:09:08 user nova-compute[75257]:       </target>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='serial0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </serial>
Nov 14 02:09:08 user nova-compute[75257]:     <console type='pty' tty='/dev/pts/8'>
Nov 14 02:09:08 user nova-compute[75257]:       <source path='/dev/pts/8'/>
Nov 14 02:09:08 user nova-compute[75257]:       <log file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log' append='off'/>
Nov 14 02:09:08 user nova-compute[75257]:       <target type='serial' port='0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='serial0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </console>
Nov 14 02:09:08 user nova-compute[75257]:     <input type='mouse' bus='ps2'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='input0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </input>
Nov 14 02:09:08 user nova-compute[75257]:     <input type='keyboard' bus='ps2'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='input1'/>
Nov 14 02:09:08 user nova-compute[75257]:     </input>
Nov 14 02:09:08 user nova-compute[75257]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 14 02:09:08 user nova-compute[75257]:       <listen type='address' address='0.0.0.0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </graphics>
Nov 14 02:09:08 user nova-compute[75257]:     <audio id='1' type='none'/>
Nov 14 02:09:08 user nova-compute[75257]:     <video>
Nov 14 02:09:08 user nova-compute[75257]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='video0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </video>
Nov 14 02:09:08 user nova-compute[75257]:     <memballoon model='virtio'>
Nov 14 02:09:08 user nova-compute[75257]:       <stats period='10'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='balloon0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </memballoon>
Nov 14 02:09:08 user nova-compute[75257]:     <rng model='virtio'>
Nov 14 02:09:08 user nova-compute[75257]:       <backend model='random'>/dev/urandom</backend>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='rng0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </rng>
Nov 14 02:09:08 user nova-compute[75257]:   </devices>
Nov 14 02:09:08 user nova-compute[75257]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 02:09:08 user nova-compute[75257]:     <label>libvirt-8de0ee5b-852a-4146-ba87-378181e1cfc4</label>
Nov 14 02:09:08 user nova-compute[75257]:     <imagelabel>libvirt-8de0ee5b-852a-4146-ba87-378181e1cfc4</imagelabel>
Nov 14 02:09:08 user nova-compute[75257]:   </seclabel>
Nov 14 02:09:08 user nova-compute[75257]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 02:09:08 user nova-compute[75257]:     <label>+64055:+108</label>
Nov 14 02:09:08 user nova-compute[75257]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 02:09:08 user nova-compute[75257]:   </seclabel>
Nov 14 02:09:08 user nova-compute[75257]: </domain>
Nov 14 02:09:08 user nova-compute[75257]:  {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface> {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:35:dd:f5"/><model type="virtio"/><mtu size="1442"/><target dev="tap07b9ece5-ed"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 14 02:09:08 user nova-compute[75257]:   <name>instance-00000008</name>
Nov 14 02:09:08 user nova-compute[75257]:   <uuid>8de0ee5b-852a-4146-ba87-378181e1cfc4</uuid>
Nov 14 02:09:08 user nova-compute[75257]:   <metadata>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:08 user nova-compute[75257]:   <nova:package version="0.0.0"/>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:name>tempest-device-tagging-server-1053798230</nova:name>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:creationTime>2023-11-14 02:09:06</nova:creationTime>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:flavor name="m1.tiny">
Nov 14 02:09:08 user nova-compute[75257]:     <nova:memory>512</nova:memory>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:disk>1</nova:disk>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:swap>0</nova:swap>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:08 user nova-compute[75257]:   </nova:flavor>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:owner>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:user uuid="3ca1d05e84d74c1ab74521dcc91f3f38">tempest-TaggedAttachmentsTest-1006457440-project-member</nova:user>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:project uuid="fe096d58b812473296c75ad5d3d5c924">tempest-TaggedAttachmentsTest-1006457440</nova:project>
Nov 14 02:09:08 user nova-compute[75257]:   </nova:owner>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:ports>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:port uuid="f0fa855e-494f-4fb7-9c5b-2022578e7a9e">
Nov 14 02:09:08 user nova-compute[75257]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:09:08 user nova-compute[75257]:     </nova:port>
Nov 14 02:09:08 user nova-compute[75257]:   </nova:ports>
Nov 14 02:09:08 user nova-compute[75257]: </nova:instance>
Nov 14 02:09:08 user nova-compute[75257]:   </metadata>
Nov 14 02:09:08 user nova-compute[75257]:   <memory unit='KiB'>524288</memory>
Nov 14 02:09:08 user nova-compute[75257]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 02:09:08 user nova-compute[75257]:   <vcpu placement='static'>1</vcpu>
Nov 14 02:09:08 user nova-compute[75257]:   <resource>
Nov 14 02:09:08 user nova-compute[75257]:     <partition>/machine</partition>
Nov 14 02:09:08 user nova-compute[75257]:   </resource>
Nov 14 02:09:08 user nova-compute[75257]:   <sysinfo type='smbios'>
Nov 14 02:09:08 user nova-compute[75257]:     <system>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='version'>0.0.0</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='serial'>8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='uuid'>8de0ee5b-852a-4146-ba87-378181e1cfc4</entry>
Nov 14 02:09:08 user nova-compute[75257]:       <entry name='family'>Virtual Machine</entry>
Nov 14 02:09:08 user nova-compute[75257]:     </system>
Nov 14 02:09:08 user nova-compute[75257]:   </sysinfo>
Nov 14 02:09:08 user nova-compute[75257]:   <os>
Nov 14 02:09:08 user nova-compute[75257]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 02:09:08 user nova-compute[75257]:     <boot dev='hd'/>
Nov 14 02:09:08 user nova-compute[75257]:     <smbios mode='sysinfo'/>
Nov 14 02:09:08 user nova-compute[75257]:   </os>
Nov 14 02:09:08 user nova-compute[75257]:   <features>
Nov 14 02:09:08 user nova-compute[75257]:     <acpi/>
Nov 14 02:09:08 user nova-compute[75257]:     <apic/>
Nov 14 02:09:08 user nova-compute[75257]:     <vmcoreinfo state='on'/>
Nov 14 02:09:08 user nova-compute[75257]:   </features>
Nov 14 02:09:08 user nova-compute[75257]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 02:09:08 user nova-compute[75257]:     <model fallback='forbid'>Nehalem</model>
Nov 14 02:09:08 user nova-compute[75257]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 02:09:08 user nova-compute[75257]:     <feature policy='require' name='vme'/>
Nov 14 02:09:08 user nova-compute[75257]:     <feature policy='require' name='x2apic'/>
Nov 14 02:09:08 user nova-compute[75257]:     <feature policy='require' name='hypervisor'/>
Nov 14 02:09:08 user nova-compute[75257]:   </cpu>
Nov 14 02:09:08 user nova-compute[75257]:   <clock offset='utc'>
Nov 14 02:09:08 user nova-compute[75257]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 02:09:08 user nova-compute[75257]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 02:09:08 user nova-compute[75257]:     <timer name='hpet' present='no'/>
Nov 14 02:09:08 user nova-compute[75257]:   </clock>
Nov 14 02:09:08 user nova-compute[75257]:   <on_poweroff>destroy</on_poweroff>
Nov 14 02:09:08 user nova-compute[75257]:   <on_reboot>restart</on_reboot>
Nov 14 02:09:08 user nova-compute[75257]:   <on_crash>destroy</on_crash>
Nov 14 02:09:08 user nova-compute[75257]:   <devices>
Nov 14 02:09:08 user nova-compute[75257]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 02:09:08 user nova-compute[75257]:     <disk type='file' device='disk'>
Nov 14 02:09:08 user nova-compute[75257]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 02:09:08 user nova-compute[75257]:       <source file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk' index='2'/>
Nov 14 02:09:08 user nova-compute[75257]:       <backingStore type='file' index='3'>
Nov 14 02:09:08 user nova-compute[75257]:         <format type='raw'/>
Nov 14 02:09:08 user nova-compute[75257]:         <source file='/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66'/>
Nov 14 02:09:08 user nova-compute[75257]:         <backingStore/>
Nov 14 02:09:08 user nova-compute[75257]:       </backingStore>
Nov 14 02:09:08 user nova-compute[75257]:       <target dev='vda' bus='virtio'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='virtio-disk0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </disk>
Nov 14 02:09:08 user nova-compute[75257]:     <disk type='file' device='cdrom'>
Nov 14 02:09:08 user nova-compute[75257]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 02:09:08 user nova-compute[75257]:       <source file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/disk.config' index='1'/>
Nov 14 02:09:08 user nova-compute[75257]:       <backingStore/>
Nov 14 02:09:08 user nova-compute[75257]:       <target dev='hda' bus='ide'/>
Nov 14 02:09:08 user nova-compute[75257]:       <readonly/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='ide0-0-0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </disk>
Nov 14 02:09:08 user nova-compute[75257]:     <controller type='usb' index='0' model='none'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='usb'/>
Nov 14 02:09:08 user nova-compute[75257]:     </controller>
Nov 14 02:09:08 user nova-compute[75257]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='pci.0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </controller>
Nov 14 02:09:08 user nova-compute[75257]:     <controller type='ide' index='0'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='ide'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 02:09:08 user nova-compute[75257]:     </controller>
Nov 14 02:09:08 user nova-compute[75257]:     <interface type='ethernet'>
Nov 14 02:09:08 user nova-compute[75257]:       <mac address='fa:16:3e:a2:65:b2'/>
Nov 14 02:09:08 user nova-compute[75257]:       <target dev='tapf0fa855e-49'/>
Nov 14 02:09:08 user nova-compute[75257]:       <model type='virtio'/>
Nov 14 02:09:08 user nova-compute[75257]:       <mtu size='1442'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='net0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </interface>
Nov 14 02:09:08 user nova-compute[75257]:     <serial type='pty'>
Nov 14 02:09:08 user nova-compute[75257]:       <source path='/dev/pts/8'/>
Nov 14 02:09:08 user nova-compute[75257]:       <log file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log' append='off'/>
Nov 14 02:09:08 user nova-compute[75257]:       <target type='isa-serial' port='0'>
Nov 14 02:09:08 user nova-compute[75257]:         <model name='isa-serial'/>
Nov 14 02:09:08 user nova-compute[75257]:       </target>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='serial0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </serial>
Nov 14 02:09:08 user nova-compute[75257]:     <console type='pty' tty='/dev/pts/8'>
Nov 14 02:09:08 user nova-compute[75257]:       <source path='/dev/pts/8'/>
Nov 14 02:09:08 user nova-compute[75257]:       <log file='/opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4/console.log' append='off'/>
Nov 14 02:09:08 user nova-compute[75257]:       <target type='serial' port='0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='serial0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </console>
Nov 14 02:09:08 user nova-compute[75257]:     <input type='mouse' bus='ps2'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='input0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </input>
Nov 14 02:09:08 user nova-compute[75257]:     <input type='keyboard' bus='ps2'>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='input1'/>
Nov 14 02:09:08 user nova-compute[75257]:     </input>
Nov 14 02:09:08 user nova-compute[75257]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 14 02:09:08 user nova-compute[75257]:       <listen type='address' address='0.0.0.0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </graphics>
Nov 14 02:09:08 user nova-compute[75257]:     <audio id='1' type='none'/>
Nov 14 02:09:08 user nova-compute[75257]:     <video>
Nov 14 02:09:08 user nova-compute[75257]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='video0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </video>
Nov 14 02:09:08 user nova-compute[75257]:     <memballoon model='virtio'>
Nov 14 02:09:08 user nova-compute[75257]:       <stats period='10'/>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='balloon0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </memballoon>
Nov 14 02:09:08 user nova-compute[75257]:     <rng model='virtio'>
Nov 14 02:09:08 user nova-compute[75257]:       <backend model='random'>/dev/urandom</backend>
Nov 14 02:09:08 user nova-compute[75257]:       <alias name='rng0'/>
Nov 14 02:09:08 user nova-compute[75257]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 02:09:08 user nova-compute[75257]:     </rng>
Nov 14 02:09:08 user nova-compute[75257]:   </devices>
Nov 14 02:09:08 user nova-compute[75257]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 02:09:08 user nova-compute[75257]:     <label>libvirt-8de0ee5b-852a-4146-ba87-378181e1cfc4</label>
Nov 14 02:09:08 user nova-compute[75257]:     <imagelabel>libvirt-8de0ee5b-852a-4146-ba87-378181e1cfc4</imagelabel>
Nov 14 02:09:08 user nova-compute[75257]:   </seclabel>
Nov 14 02:09:08 user nova-compute[75257]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 02:09:08 user nova-compute[75257]:     <label>+64055:+108</label>
Nov 14 02:09:08 user nova-compute[75257]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 02:09:08 user nova-compute[75257]:   </seclabel>
Nov 14 02:09:08 user nova-compute[75257]: </domain>
Nov 14 02:09:08 user nova-compute[75257]:  {{(pid=75257) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 02:09:08 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Detaching interface fa:16:3e:35:dd:f5 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap07b9ece5-ed' not found.
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053798230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053798230',id=8,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA==',key_name='tempest-keypair-1715447766',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe096d58b812473296c75ad5d3d5c924',ramdisk_id='',reservation_id='r-m0bnejek',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1006457440',owner_user_name='tempest-TaggedAttachmentsTest-1006457440-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ca1d05e84d74c1ab74521dcc91f3f38',uuid=8de0ee5b-852a-4146-ba87-378181e1cfc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Converting VIF {"id": "07b9ece5-ed71-42e9-ae00-72829af206e8", "address": "fa:16:3e:35:dd:f5", "network": {"id": "19fed474-e44a-4cbb-942e-f5c5078883d9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1072321995", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b9ece5-ed", "ovs_interfaceid": "07b9ece5-ed71-42e9-ae00-72829af206e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG os_vif [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07b9ece5-ed, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:08 user nova-compute[75257]: INFO os_vif [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:dd:f5,bridge_name='br-int',has_traffic_filtering=True,id=07b9ece5-ed71-42e9-ae00-72829af206e8,network=Network(19fed474-e44a-4cbb-942e-f5c5078883d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b9ece5-ed')
Nov 14 02:09:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [req-1b196d80-7cae-450a-9962-8c86c6577468 req-04d79d2a-4096-4cd2-9670-eac8b68cf59f service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:08 user nova-compute[75257]:   <nova:package version="0.0.0"/>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:name>tempest-device-tagging-server-1053798230</nova:name>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:creationTime>2023-11-14 02:09:08</nova:creationTime>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:flavor name="m1.tiny">
Nov 14 02:09:08 user nova-compute[75257]:     <nova:memory>512</nova:memory>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:disk>1</nova:disk>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:swap>0</nova:swap>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:08 user nova-compute[75257]:   </nova:flavor>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:owner>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:user uuid="3ca1d05e84d74c1ab74521dcc91f3f38">tempest-TaggedAttachmentsTest-1006457440-project-member</nova:user>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:project uuid="fe096d58b812473296c75ad5d3d5c924">tempest-TaggedAttachmentsTest-1006457440</nova:project>
Nov 14 02:09:08 user nova-compute[75257]:   </nova:owner>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:08 user nova-compute[75257]:   <nova:ports>
Nov 14 02:09:08 user nova-compute[75257]:     <nova:port uuid="f0fa855e-494f-4fb7-9c5b-2022578e7a9e">
Nov 14 02:09:08 user nova-compute[75257]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:09:08 user nova-compute[75257]:     </nova:port>
Nov 14 02:09:08 user nova-compute[75257]:   </nova:ports>
Nov 14 02:09:08 user nova-compute[75257]: </nova:instance>
Nov 14 02:09:08 user nova-compute[75257]:  {{(pid=75257) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:09:10 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Instance spawned successfully.
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received event network-vif-plugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] Acquiring lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] No waiting events found dispatching network-vif-plugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:10 user nova-compute[75257]: WARNING nova.compute.manager [req-7846df47-f335-4445-a9fa-0b9dd895e714 req-f46edb22-4b47-45c6-a3c7-6880c8b2816e service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received unexpected event network-vif-plugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance with vm_state building and task_state spawning.
Nov 14 02:09:10 user nova-compute[75257]: INFO nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 14 02:09:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:09:10 user nova-compute[75257]: INFO nova.compute.manager [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Took 6.65 seconds to build instance.
Nov 14 02:09:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7dbe22ac-1265-4575-b208-6b9780a5fb67 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.780s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:18 user nova-compute[75257]: INFO nova.compute.manager [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Terminating instance
Nov 14 02:09:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received event network-vif-unplugged-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] No waiting events found dispatching network-vif-unplugged-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-b3bd64c4-da96-42c7-abb4-e42fffa307aa req-aa6553ad-af63-416a-a78b-58fa3b29481c service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received event network-vif-unplugged-fb5f3206-b474-4ff1-b22a-ec6169264796 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:09:19 user nova-compute[75257]: INFO nova.compute.claims [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Claim successful on node user
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Instance destroyed successfully.
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lazy-loading 'resources' on Instance uuid a1326183-c4cb-40fa-a352-470e2c69cb05 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1913356881',display_name='tempest-VolumesAssistedSnapshotsTest-server-1913356881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1913356881',id=9,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGic6H0CdbSyqWBGVsfiHfK2deh7upIvHfskva2vI9QFGjB0wM99ch4Bmnjjiz/IbnT0KpD62foVYAD+LVpz8dcQuiZCCKbwh3weEBJ4wNafEgEQnWVVxhuPeAEf4PASQ==',key_name='tempest-keypair-1172015827',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da668843b57c40ee9f230c5912bb2709',ramdisk_id='',reservation_id='r-fy0dzcng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-762191271',owner_user_name='tempest-VolumesAssistedSnapshotsTest-762191271-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90a4a3f1b20246e3b1e50bbd76a498fd',uuid=a1326183-c4cb-40fa-a352-470e2c69cb05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Converting VIF {"id": "fb5f3206-b474-4ff1-b22a-ec6169264796", "address": "fa:16:3e:94:45:07", "network": {"id": "70e9fb82-e77b-420b-90ec-b92382c04f69", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-660834279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da668843b57c40ee9f230c5912bb2709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb5f3206-b4", "ovs_interfaceid": "fb5f3206-b474-4ff1-b22a-ec6169264796", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:45:07,bridge_name='br-int',has_traffic_filtering=True,id=fb5f3206-b474-4ff1-b22a-ec6169264796,network=Network(70e9fb82-e77b-420b-90ec-b92382c04f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5f3206-b4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG os_vif [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:45:07,bridge_name='br-int',has_traffic_filtering=True,id=fb5f3206-b474-4ff1-b22a-ec6169264796,network=Network(70e9fb82-e77b-420b-90ec-b92382c04f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5f3206-b4') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb5f3206-b4, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0ce9e89-2159-4863-a8ae-80a7f88e9e93) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:19 user nova-compute[75257]: INFO os_vif [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:45:07,bridge_name='br-int',has_traffic_filtering=True,id=fb5f3206-b474-4ff1-b22a-ec6169264796,network=Network(70e9fb82-e77b-420b-90ec-b92382c04f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb5f3206-b4')
Nov 14 02:09:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Deleting instance files /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05_del
Nov 14 02:09:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Deletion of /opt/stack/data/nova/instances/a1326183-c4cb-40fa-a352-470e2c69cb05_del complete
Nov 14 02:09:19 user nova-compute[75257]: INFO nova.compute.manager [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 14 02:09:19 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.791s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:09:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:09:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:09:20 user nova-compute[75257]: INFO nova.virt.block_device [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Booting with volume b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 at /dev/vda
Nov 14 02:09:20 user nova-compute[75257]: DEBUG os_brick.utils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[453cdf1a-ca80-4d3d-ad31-c68300db8b2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d75b03-d692-47eb-a156-080881e84447]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f0c23-c5f8-4c54-9b02-36ae53d133f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d88998-50a9-4667-96d6-3eb6919e9615]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:20 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e94161-ec6c-4e26-813e-fb9f8f7d6932]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG os_brick.utils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating existing volume attachment record: 29bc90fd-1f28-4cf6-b56d-49a3f6b2decf {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG nova.policy [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afc679b09a1643b2963e33a2c5059cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8e8769c7e544a05a5a9ac80bda1639b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received event network-vif-plugged-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] Acquiring lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] No waiting events found dispatching network-vif-plugged-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:20 user nova-compute[75257]: WARNING nova.compute.manager [req-092ad302-2e74-4e93-9467-6cd28acf587f req-ef674783-a420-4839-9a89-b39ef6c2c516 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received unexpected event network-vif-plugged-fb5f3206-b474-4ff1-b22a-ec6169264796 for instance with vm_state active and task_state deleting.
Nov 14 02:09:21 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:21 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Took 1.57 seconds to deallocate network for instance.
Nov 14 02:09:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-aa1aa920-d419-4df7-99d9-584d06cfdc0d req-5e8c2fee-410d-4c65-8c89-3f88fc6772d8 service nova] [instance: a1326183-c4cb-40fa-a352-470e2c69cb05] Received event network-vif-deleted-fb5f3206-b474-4ff1-b22a-ec6169264796 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:21 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully created port: dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:09:21 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:09:21 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:09:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:21 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Deleted allocations for instance a1326183-c4cb-40fa-a352-470e2c69cb05
Nov 14 02:09:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2d082715-6762-4f20-9d1c-1200780de62c tempest-VolumesAssistedSnapshotsTest-762191271 tempest-VolumesAssistedSnapshotsTest-762191271-project-member] Lock "a1326183-c4cb-40fa-a352-470e2c69cb05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.545s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:22 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully created port: bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:09:22 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully created port: 02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:09:23 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully created port: 135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:09:23 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully created port: 8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:09:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully updated port: dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:09:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-changed-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing instance network info cache due to event network-changed-dee8e8d1-721c-4209-8bd4-b0c873f68c66. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] Acquiring lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] Acquired lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:24 user nova-compute[75257]: DEBUG nova.network.neutron [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing network info cache for port dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:24 user nova-compute[75257]: DEBUG nova.network.neutron [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:09:25 user nova-compute[75257]: INFO nova.virt.block_device [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Booting with volume 41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 at /dev/vdb
Nov 14 02:09:25 user nova-compute[75257]: DEBUG os_brick.utils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc2a4ed-3499-4643-9041-92bdc6de5ef2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d61b47-e671-4477-8243-be4d82f5a192]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[23239c4d-43f7-4d14-8561-8704c9410174]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d12cba-2861-4cd7-9ec1-2273f670942b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:25 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c9d6a7-f3e4-4d7a-9f02-fdf3024e4fcb]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG os_brick.utils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating existing volume attachment record: 17ed801f-fd6a-4a32-a33a-445cbee92c9d {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG nova.network.neutron [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0d99b2e1-045e-40e1-8aca-bb96ff5f9c33 req-dc4ca043-ffe5-4396-bfc9-34609a5fd743 service nova] Releasing lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:25 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully updated port: 90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:09:26 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully updated port: 4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:09:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-changed-90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing instance network info cache due to event network-changed-90c018ce-1c12-4cb8-9d98-070fd8a1810a. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Acquiring lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Acquired lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:26 user nova-compute[75257]: DEBUG nova.network.neutron [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing network info cache for port 90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:26 user nova-compute[75257]: DEBUG nova.network.neutron [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG nova.network.neutron [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Releasing lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-changed-4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing instance network info cache due to event network-changed-4a898ff3-bac1-49d0-8d99-f3fc06539056. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Acquiring lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Acquired lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG nova.network.neutron [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing network info cache for port 4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG nova.network.neutron [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully updated port: bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG nova.network.neutron [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-35851c1f-100e-4fcd-9a62-62a5431fe497 req-5973e8b2-838f-420a-a66d-a5026303e664 service nova] Releasing lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:27 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully updated port: 02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:09:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully updated port: 135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:09:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-changed-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing instance network info cache due to event network-changed-bcd5d4d3-5459-408b-8924-5f08d38ccb8e. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Acquiring lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Acquired lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:28 user nova-compute[75257]: DEBUG nova.network.neutron [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing network info cache for port bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:28 user nova-compute[75257]: DEBUG nova.network.neutron [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Releasing lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-changed-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing instance network info cache due to event network-changed-02264a33-a74b-4f31-b3f0-6c416fc4f7a1. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Acquiring lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Acquired lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing network info cache for port 02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Releasing lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-changed-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing instance network info cache due to event network-changed-135ef6eb-a5e3-4537-b64f-404b6bca66f5. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Acquiring lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Acquired lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing network info cache for port 135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Successfully updated port: 8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:09:29 user nova-compute[75257]: INFO nova.virt.block_device [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Booting with volume 80a21b79-bdd1-4efb-b413-c3e783a6770f at /dev/vdc
Nov 14 02:09:29 user nova-compute[75257]: DEBUG os_brick.utils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dd8152-ee09-4ec2-aeb0-84383741593d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff49a5b-698e-4c1a-beaf-ce099b14bb92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b7780-e782-4741-a1e7-2edf1d7ff6b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddce7a5b-afab-43d9-beac-3c3f5d66a0a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:29 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e94d91-f30d-4204-9b1c-c1b3938bafe8]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG os_brick.utils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating existing volume attachment record: 0b42c361-a6d6-4d14-95f7-5505c9fab33b {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37724be7-0b93-4ed2-815d-95aa05c2a71e req-d163030d-d749-4046-8184-5040596de847 service nova] Releasing lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquired lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:09:29 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:09:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-changed-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing instance network info cache due to event network-changed-8a2fed29-201a-4e15-a780-532c03191f10. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] Acquiring lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [{"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Releasing lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance network_info: |[{"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:09:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] Acquired lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:31 user nova-compute[75257]: DEBUG nova.network.neutron [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing network info cache for port 8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:32 user nova-compute[75257]: DEBUG nova.network.neutron [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updated VIF entry in instance network info cache for port 8a2fed29-201a-4e15-a780-532c03191f10. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:09:32 user nova-compute[75257]: DEBUG nova.network.neutron [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [{"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0db46ffa-69a8-4a53-ad10-20f058cbf806 req-6ae2b159-e5fb-4911-a9a4-65140142727c service nova] Releasing lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:09:34 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Creating image(s)
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Ensure instance console log exists: /opt/stack/data/nova/instances/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Start _get_guest_xml network_info=[{"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '29bc90fd-1f28-4cf6-b56d-49a3f6b2decf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSmewBua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889', 'attached_at': '', 'detached_at': '', 'volume_id': 'b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852', 'serial': 'b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '17ed801f-fd6a-4a32-a33a-445cbee92c9d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Fjhlfxmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889', 'attached_at': '', 'detached_at': '', 'volume_id': '41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93', 'serial': '41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93'}, 'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '0b42c361-a6d6-4d14-95f7-5505c9fab33b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roheIsYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889', 'attached_at': '', 'detached_at': '', 'volume_id': '80a21b79-bdd1-4efb-b413-c3e783a6770f', 'serial': '80a21b79-bdd1-4efb-b413-c3e783a6770f'}, 'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:09:34 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:34 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSmewBua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:34 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:34 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:34 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:09:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b979884-9a29-46e4-8848-58664113960d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:09:34 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a3cb6e-d85f-49d9-bea2-db0fb42a04ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852] added
Nov 14 02:09:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe27260a-ad55-4395-9696-e21b5f962454]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc66e834-5f7a-4bc7-a14e-f7d4a21e3024]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSmewBua {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSmewBua" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ca866-432d-4bb3-8fa0-22f9b8d291d6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dSmewBua'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7511cbb8-4b1c-4c69-9a82-1b0b83ad5579]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dbd474-b87e-490a-8503-8a2a46a61703]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:34 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:34 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2852894-befd-4022-9a58-c14e31fcf258]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852, portal: 172.16.0.220,3260]
Nov 14 02:09:34 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852, portal: 172.16.0.220,3260] successful.
Nov 14 02:09:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7120c83a-4e5e-48bd-a8dd-4ce4dd68950e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bb5385-d2b5-4765-ad41-7c325d1f31c1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:34 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:34 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:34 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:34 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7101fe-d9c3-44b9-986d-c6bad58e0909]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:09:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSmewBua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23966363636386464', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966363636386464', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Fjhlfxmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:35 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:35 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:35 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7ac641-5ed6-469e-a199-1bb6a183acdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:09:35 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[706d5151-ba3b-4dc6-9746-ccda8ca59f36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93] added
Nov 14 02:09:35 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5ced50-7a1c-45e5-87a2-eafb5702f3d3]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07883a9-b25e-49c2-aa82-4c16f041f0b5]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Fjhlfxmq {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Fjhlfxmq" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1649e76-f8c4-4572-b822-837207db71c6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Fjhlfxmq'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98e1479-7cb8-4a6e-bd1e-59637b7b2b2c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85bfacb-b8b7-404f-8e27-c45dfac40b09]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[401e5e5b-4bff-4db9-a395-58e567f2e223]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93, portal: 172.16.0.220,3260]
Nov 14 02:09:36 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93, portal: 172.16.0.220,3260] successful.
Nov 14 02:09:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e9f7b-4f2d-4823-afb7-161a9df16009]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b049a06f-aab8-4d47-bc82-0f7adece15e8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:36 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[002b76fb-15ff-423d-98a6-4abee11394f5]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Fjhlfxmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:09:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26565353239336333', 'path': '/dev/sde'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565353239336333', 'path': '/dev/sde'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:09:37 user nova-compute[75257]: INFO nova.compute.manager [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Terminating instance
Nov 14 02:09:37 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roheIsYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:37 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:37 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:37 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cffb7f9-0fa7-4603-9c70-7fae0b7028b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:09:37 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c966f4-ba84-4996-bd6a-d045e4e28c34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f] added
Nov 14 02:09:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7df7ba-e892-4f2a-8989-f00f92d88bc1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91d8fa4-3764-4bd5-acc8-d814c8b84a44]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roheIsYk {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roheIsYk" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[492b06e0-92f5-4044-8851-b20e6ece2354]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'roheIsYk'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98ad7e2-9882-4253-9bdc-9015bcd8bf91]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[257bf889-9b54-4243-b0ee-f8763ba68cea]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-unplugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-unplugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-752e9530-3ef4-49a0-bf11-bf09950d56e4 req-e2d5517a-722a-4692-aa45-c88c157d5648 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-unplugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b530e1-aaaf-4303-ad84-bd7f922d5f27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f, portal: 172.16.0.220,3260]
Nov 14 02:09:37 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f, portal: 172.16.0.220,3260] successful.
Nov 14 02:09:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91e5187-8fb8-4769-bc0e-bd55ce41d277]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee02e6cd-37d4-48ff-b93a-da4bcc1e1e9f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:37 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d600707-657a-47ed-8e3e-35a2ee9a1fdc]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "b950c25e-2910-4de3-a9fc-30e4091dfe19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:37 user nova-compute[75257]: INFO nova.compute.manager [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Terminating instance
Nov 14 02:09:37 user nova-compute[75257]: DEBUG nova.compute.manager [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Instance destroyed successfully.
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lazy-loading 'resources' on Instance uuid 8de0ee5b-852a-4146-ba87-378181e1cfc4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Instance destroyed successfully.
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.objects.instance [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lazy-loading 'resources' on Instance uuid b950c25e-2910-4de3-a9fc-30e4091dfe19 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053798230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053798230',id=8,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmVdbLQrPn7/R/o5U3Xj67C3Lj2bkrIfod4h6EcqMDwpjGYdQnjSWvNmVjglgceMGr4WZoQYmGNQWWMSS/+leHgTrEQwYyspARgSA2u914zwrK1lx3Y/LKpTt9XQ1ROMA==',key_name='tempest-keypair-1715447766',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe096d58b812473296c75ad5d3d5c924',ramdisk_id='',reservation_id='r-m0bnejek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1006457440',owner_user_name='tempest-TaggedAttachmentsTest-1006457440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ca1d05e84d74c1ab74521dcc91f3f38',uuid=8de0ee5b-852a-4146-ba87-378181e1cfc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converting VIF {"id": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "address": "fa:16:3e:a2:65:b2", "network": {"id": "92fc7073-a06d-44ea-bb1b-c86ace99eec2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145116921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe096d58b812473296c75ad5d3d5c924", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0fa855e-49", "ovs_interfaceid": "f0fa855e-494f-4fb7-9c5b-2022578e7a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=f0fa855e-494f-4fb7-9c5b-2022578e7a9e,network=Network(92fc7073-a06d-44ea-bb1b-c86ace99eec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa855e-49') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG os_vif [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=f0fa855e-494f-4fb7-9c5b-2022578e7a9e,network=Network(92fc7073-a06d-44ea-bb1b-c86ace99eec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa855e-49') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0fa855e-49, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1101070144',display_name='tempest-ServersNegativeTestJSON-server-1101070144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1101070144',id=11,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:07:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df2958ade8524b6e9c245384d7fe9b92',ramdisk_id='',reservation_id='r-i35kv15h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1705676333',owner_user_name='tempest-ServersNegativeTestJSON-1705676333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:07:56Z,user_data=None,user_id='1bf2a54e5cb84e16b3218e3ca1f2fbdc',uuid=b950c25e-2910-4de3-a9fc-30e4091dfe19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converting VIF {"id": "3ec017bb-c846-419e-a33f-860b071d3b18", "address": "fa:16:3e:8d:1f:f8", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec017bb-c8", "ovs_interfaceid": "3ec017bb-c846-419e-a33f-860b071d3b18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1f:f8,bridge_name='br-int',has_traffic_filtering=True,id=3ec017bb-c846-419e-a33f-860b071d3b18,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec017bb-c8') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG os_vif [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1f:f8,bridge_name='br-int',has_traffic_filtering=True,id=3ec017bb-c846-419e-a33f-860b071d3b18,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec017bb-c8') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ec017bb-c8, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bb9d8f5-d447-4cbb-a258-37d4a26d9872) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbbd5931-fc01-42d5-ae26-0a627ef31b1d) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: INFO os_vif [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:65:b2,bridge_name='br-int',has_traffic_filtering=True,id=f0fa855e-494f-4fb7-9c5b-2022578e7a9e,network=Network(92fc7073-a06d-44ea-bb1b-c86ace99eec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0fa855e-49')
Nov 14 02:09:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Deleting instance files /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4_del
Nov 14 02:09:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Deletion of /opt/stack/data/nova/instances/8de0ee5b-852a-4146-ba87-378181e1cfc4_del complete
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: INFO os_vif [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1f:f8,bridge_name='br-int',has_traffic_filtering=True,id=3ec017bb-c846-419e-a33f-860b071d3b18,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec017bb-c8')
Nov 14 02:09:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Deleting instance files /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19_del
Nov 14 02:09:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Deletion of /opt/stack/data/nova/instances/b950c25e-2910-4de3-a9fc-30e4091dfe19_del complete
Nov 14 02:09:38 user nova-compute[75257]: INFO nova.compute.manager [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 14 02:09:38 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:09:38 user nova-compute[75257]: INFO nova.compute.manager [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 02:09:38 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roheIsYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '26135373038343935', 'path': '/dev/sdf'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135373038343935', 'path': '/dev/sdf'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2d:6a,bridge_name='br-int',has_traffic_filtering=True,id=dee8e8d1-721c-4209-8bd4-b0c873f68c66,network=Network(2e1fdf2a-bf16-456d-ab5a-3d43518b2c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8e8d1-72') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:dc:54,bridge_name='br-int',has_traffic_filtering=True,id=90c018ce-1c12-4cb8-9d98-070fd8a1810a,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap90c018ce-1c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=4a898ff3-bac1-49d0-8d99-f3fc06539056,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a898ff3-ba') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=bcd5d4d3-5459-408b-8924-5f08d38ccb8e,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd5d4d3-54') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3b:b0,bridge_name='br-int',has_traffic_filtering=True,id=02264a33-a74b-4f31-b3f0-6c416fc4f7a1,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02264a33-a7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ac:f0,bridge_name='br-int',has_traffic_filtering=True,id=135ef6eb-a5e3-4537-b64f-404b6bca66f5,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ef6eb-a5') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fe:41,bridge_name='br-int',has_traffic_filtering=True,id=8a2fed29-201a-4e15-a780-532c03191f10,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2fed29-20') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.objects.instance [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lazy-loading 'pci_devices' on Instance uuid efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:09:38 user nova-compute[75257]:   <uuid>efcc83ac-1f8b-43bd-84a1-36c6ab4fa889</uuid>
Nov 14 02:09:38 user nova-compute[75257]:   <name>instance-0000000e</name>
Nov 14 02:09:38 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:09:38 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:09:38 user nova-compute[75257]:   <metadata>
Nov 14 02:09:38 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:38 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:09:38 user nova-compute[75257]:       <nova:name>tempest-device-tagging-server-1564274647</nova:name>
Nov 14 02:09:38 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:09:34</nova:creationTime>
Nov 14 02:09:38 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:09:38 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:38 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:09:38 user nova-compute[75257]:       <nova:owner>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:user uuid="afc679b09a1643b2963e33a2c5059cd8">tempest-TaggedBootDevicesTest_v242-322022406-project-member</nova:user>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:project uuid="a8e8769c7e544a05a5a9ac80bda1639b">tempest-TaggedBootDevicesTest_v242-322022406</nova:project>
Nov 14 02:09:38 user nova-compute[75257]:       </nova:owner>
Nov 14 02:09:38 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:38 user nova-compute[75257]:       <nova:ports>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:port uuid="dee8e8d1-721c-4209-8bd4-b0c873f68c66">
Nov 14 02:09:38 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 02:09:38 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:port uuid="90c018ce-1c12-4cb8-9d98-070fd8a1810a">
Nov 14 02:09:38 user nova-compute[75257]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Nov 14 02:09:38 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:port uuid="4a898ff3-bac1-49d0-8d99-f3fc06539056">
Nov 14 02:09:38 user nova-compute[75257]:           <nova:ip type="fixed" address="10.1.1.136" ipVersion="4"/>
Nov 14 02:09:38 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:port uuid="bcd5d4d3-5459-408b-8924-5f08d38ccb8e">
Nov 14 02:09:38 user nova-compute[75257]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Nov 14 02:09:38 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:port uuid="02264a33-a74b-4f31-b3f0-6c416fc4f7a1">
Nov 14 02:09:38 user nova-compute[75257]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Nov 14 02:09:38 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:port uuid="135ef6eb-a5e3-4537-b64f-404b6bca66f5">
Nov 14 02:09:38 user nova-compute[75257]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 02:09:38 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:38 user nova-compute[75257]:         <nova:port uuid="8a2fed29-201a-4e15-a780-532c03191f10">
Nov 14 02:09:38 user nova-compute[75257]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 02:09:38 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:38 user nova-compute[75257]:       </nova:ports>
Nov 14 02:09:38 user nova-compute[75257]:     </nova:instance>
Nov 14 02:09:38 user nova-compute[75257]:   </metadata>
Nov 14 02:09:38 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:09:38 user nova-compute[75257]:     <system>
Nov 14 02:09:38 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:09:38 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:09:38 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:09:38 user nova-compute[75257]:       <entry name="serial">efcc83ac-1f8b-43bd-84a1-36c6ab4fa889</entry>
Nov 14 02:09:38 user nova-compute[75257]:       <entry name="uuid">efcc83ac-1f8b-43bd-84a1-36c6ab4fa889</entry>
Nov 14 02:09:38 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:09:38 user nova-compute[75257]:     </system>
Nov 14 02:09:38 user nova-compute[75257]:   </sysinfo>
Nov 14 02:09:38 user nova-compute[75257]:   <os>
Nov 14 02:09:38 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:09:38 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:09:38 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:09:38 user nova-compute[75257]:   </os>
Nov 14 02:09:38 user nova-compute[75257]:   <features>
Nov 14 02:09:38 user nova-compute[75257]:     <acpi/>
Nov 14 02:09:38 user nova-compute[75257]:     <apic/>
Nov 14 02:09:38 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:09:38 user nova-compute[75257]:   </features>
Nov 14 02:09:38 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:09:38 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:09:38 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:09:38 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:09:38 user nova-compute[75257]:   </clock>
Nov 14 02:09:38 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:09:38 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:09:38 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:09:38 user nova-compute[75257]:   </cpu>
Nov 14 02:09:38 user nova-compute[75257]:   <devices>
Nov 14 02:09:38 user nova-compute[75257]:     <disk type="file" device="cdrom">
Nov 14 02:09:38 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 02:09:38 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/disk.config"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="hda" bus="ide"/>
Nov 14 02:09:38 user nova-compute[75257]:     </disk>
Nov 14 02:09:38 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:09:38 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:09:38 user nova-compute[75257]:       <source dev="/dev/sdb"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <serial>b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852</serial>
Nov 14 02:09:38 user nova-compute[75257]:     </disk>
Nov 14 02:09:38 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:09:38 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:09:38 user nova-compute[75257]:       <source dev="/dev/sde"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <serial>41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93</serial>
Nov 14 02:09:38 user nova-compute[75257]:     </disk>
Nov 14 02:09:38 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:09:38 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:09:38 user nova-compute[75257]:       <source dev="/dev/sdf"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="vdc" bus="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <serial>80a21b79-bdd1-4efb-b413-c3e783a6770f</serial>
Nov 14 02:09:38 user nova-compute[75257]:     </disk>
Nov 14 02:09:38 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:38 user nova-compute[75257]:       <mac address="fa:16:3e:1a:2d:6a"/>
Nov 14 02:09:38 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="tapdee8e8d1-72"/>
Nov 14 02:09:38 user nova-compute[75257]:     </interface>
Nov 14 02:09:38 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:38 user nova-compute[75257]:       <mac address="fa:16:3e:8b:dc:54"/>
Nov 14 02:09:38 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="tap90c018ce-1c"/>
Nov 14 02:09:38 user nova-compute[75257]:     </interface>
Nov 14 02:09:38 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:38 user nova-compute[75257]:       <mac address="fa:16:3e:c8:8d:80"/>
Nov 14 02:09:38 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="tap4a898ff3-ba"/>
Nov 14 02:09:38 user nova-compute[75257]:     </interface>
Nov 14 02:09:38 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:38 user nova-compute[75257]:       <mac address="fa:16:3e:2d:0c:04"/>
Nov 14 02:09:38 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="tapbcd5d4d3-54"/>
Nov 14 02:09:38 user nova-compute[75257]:     </interface>
Nov 14 02:09:38 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:38 user nova-compute[75257]:       <mac address="fa:16:3e:aa:3b:b0"/>
Nov 14 02:09:38 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="tap02264a33-a7"/>
Nov 14 02:09:38 user nova-compute[75257]:     </interface>
Nov 14 02:09:38 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:38 user nova-compute[75257]:       <mac address="fa:16:3e:dd:ac:f0"/>
Nov 14 02:09:38 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="tap135ef6eb-a5"/>
Nov 14 02:09:38 user nova-compute[75257]:     </interface>
Nov 14 02:09:38 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:38 user nova-compute[75257]:       <mac address="fa:16:3e:9a:fe:41"/>
Nov 14 02:09:38 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:38 user nova-compute[75257]:       <target dev="tap8a2fed29-20"/>
Nov 14 02:09:38 user nova-compute[75257]:     </interface>
Nov 14 02:09:38 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:09:38 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/console.log" append="off"/>
Nov 14 02:09:38 user nova-compute[75257]:     </serial>
Nov 14 02:09:38 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:09:38 user nova-compute[75257]:     <video>
Nov 14 02:09:38 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:38 user nova-compute[75257]:     </video>
Nov 14 02:09:38 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:09:38 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:09:38 user nova-compute[75257]:     </rng>
Nov 14 02:09:38 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:09:38 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:09:38 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:09:38 user nova-compute[75257]:     </memballoon>
Nov 14 02:09:38 user nova-compute[75257]:   </devices>
Nov 14 02:09:38 user nova-compute[75257]: </domain>
Nov 14 02:09:38 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2d:6a,bridge_name='br-int',has_traffic_filtering=True,id=dee8e8d1-721c-4209-8bd4-b0c873f68c66,network=Network(2e1fdf2a-bf16-456d-ab5a-3d43518b2c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8e8d1-72') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2d:6a,bridge_name='br-int',has_traffic_filtering=True,id=dee8e8d1-721c-4209-8bd4-b0c873f68c66,network=Network(2e1fdf2a-bf16-456d-ab5a-3d43518b2c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8e8d1-72') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ea5f00f-1c13-537a-a99c-278b5d82c1fe', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdee8e8d1-72, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdee8e8d1-72, col_values=(('qos', UUID('c3f169c4-6af9-4d3b-b83b-ebca7b4c0856')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdee8e8d1-72, col_values=(('external_ids', {'iface-id': 'dee8e8d1-721c-4209-8bd4-b0c873f68c66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:2d:6a', 'vm-uuid': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: INFO os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:2d:6a,bridge_name='br-int',has_traffic_filtering=True,id=dee8e8d1-721c-4209-8bd4-b0c873f68c66,network=Network(2e1fdf2a-bf16-456d-ab5a-3d43518b2c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8e8d1-72')
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:dc:54,bridge_name='br-int',has_traffic_filtering=True,id=90c018ce-1c12-4cb8-9d98-070fd8a1810a,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap90c018ce-1c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:dc:54,bridge_name='br-int',has_traffic_filtering=True,id=90c018ce-1c12-4cb8-9d98-070fd8a1810a,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap90c018ce-1c') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b97900a4-715d-53ba-89b0-b696637e8e8b', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90c018ce-1c, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90c018ce-1c, col_values=(('qos', UUID('c0dea9f5-e555-45a6-a96f-1227d6eaee09')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90c018ce-1c, col_values=(('external_ids', {'iface-id': '90c018ce-1c12-4cb8-9d98-070fd8a1810a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:dc:54', 'vm-uuid': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: INFO os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:dc:54,bridge_name='br-int',has_traffic_filtering=True,id=90c018ce-1c12-4cb8-9d98-070fd8a1810a,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap90c018ce-1c')
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=4a898ff3-bac1-49d0-8d99-f3fc06539056,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a898ff3-ba') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=4a898ff3-bac1-49d0-8d99-f3fc06539056,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a898ff3-ba') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e34edf85-aeae-5003-b37f-f0af3c03af15', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a898ff3-ba, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a898ff3-ba, col_values=(('qos', UUID('6ba5c1ed-8901-4bf3-935a-e08af23a18ad')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a898ff3-ba, col_values=(('external_ids', {'iface-id': '4a898ff3-bac1-49d0-8d99-f3fc06539056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:8d:80', 'vm-uuid': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: INFO os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=4a898ff3-bac1-49d0-8d99-f3fc06539056,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a898ff3-ba')
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=bcd5d4d3-5459-408b-8924-5f08d38ccb8e,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd5d4d3-54') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=bcd5d4d3-5459-408b-8924-5f08d38ccb8e,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd5d4d3-54') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '276ba5b9-79a0-52b9-a9f7-5ef7e8782a78', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcd5d4d3-54, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcd5d4d3-54, col_values=(('qos', UUID('85400758-56a8-4be0-8af6-a0f000e8d6ec')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcd5d4d3-54, col_values=(('external_ids', {'iface-id': 'bcd5d4d3-5459-408b-8924-5f08d38ccb8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:0c:04', 'vm-uuid': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: INFO os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=bcd5d4d3-5459-408b-8924-5f08d38ccb8e,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd5d4d3-54')
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3b:b0,bridge_name='br-int',has_traffic_filtering=True,id=02264a33-a74b-4f31-b3f0-6c416fc4f7a1,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02264a33-a7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3b:b0,bridge_name='br-int',has_traffic_filtering=True,id=02264a33-a74b-4f31-b3f0-6c416fc4f7a1,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02264a33-a7') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0d82dfb-0161-58ac-a031-187411afd339', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02264a33-a7, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02264a33-a7, col_values=(('qos', UUID('5606fe91-d97e-425f-83ef-dd259114eedf')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02264a33-a7, col_values=(('external_ids', {'iface-id': '02264a33-a74b-4f31-b3f0-6c416fc4f7a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:3b:b0', 'vm-uuid': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: INFO os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3b:b0,bridge_name='br-int',has_traffic_filtering=True,id=02264a33-a74b-4f31-b3f0-6c416fc4f7a1,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02264a33-a7')
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ac:f0,bridge_name='br-int',has_traffic_filtering=True,id=135ef6eb-a5e3-4537-b64f-404b6bca66f5,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ef6eb-a5') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ac:f0,bridge_name='br-int',has_traffic_filtering=True,id=135ef6eb-a5e3-4537-b64f-404b6bca66f5,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ef6eb-a5') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a682b29-ec2d-54ed-9ee4-1be629c41af4', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap135ef6eb-a5, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap135ef6eb-a5, col_values=(('qos', UUID('c269d268-394b-43b7-ac3e-6e4a1e373df4')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap135ef6eb-a5, col_values=(('external_ids', {'iface-id': '135ef6eb-a5e3-4537-b64f-404b6bca66f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:ac:f0', 'vm-uuid': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: INFO os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ac:f0,bridge_name='br-int',has_traffic_filtering=True,id=135ef6eb-a5e3-4537-b64f-404b6bca66f5,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ef6eb-a5')
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fe:41,bridge_name='br-int',has_traffic_filtering=True,id=8a2fed29-201a-4e15-a780-532c03191f10,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2fed29-20') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fe:41,bridge_name='br-int',has_traffic_filtering=True,id=8a2fed29-201a-4e15-a780-532c03191f10,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2fed29-20') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '494cd1b3-7f9c-566d-af0c-7d8e7e6dc46d', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a2fed29-20, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a2fed29-20, col_values=(('qos', UUID('e707358c-dcf4-4365-9ab7-735396c3c6a2')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a2fed29-20, col_values=(('external_ids', {'iface-id': '8a2fed29-201a-4e15-a780-532c03191f10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:fe:41', 'vm-uuid': 'efcc83ac-1f8b-43bd-84a1-36c6ab4fa889'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:39 user nova-compute[75257]: WARNING nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance with vm_state active and task_state deleting.
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received event network-vif-unplugged-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Acquiring lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] No waiting events found dispatching network-vif-unplugged-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received event network-vif-unplugged-3ec017bb-c846-419e-a33f-860b071d3b18 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received event network-vif-plugged-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Acquiring lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] No waiting events found dispatching network-vif-plugged-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:39 user nova-compute[75257]: WARNING nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received unexpected event network-vif-plugged-3ec017bb-c846-419e-a33f-860b071d3b18 for instance with vm_state active and task_state deleting.
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:39 user nova-compute[75257]: WARNING nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance with vm_state active and task_state deleting.
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:39 user nova-compute[75257]: WARNING nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance with vm_state active and task_state deleting.
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-unplugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-unplugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-a10a447c-2ec5-4b4b-858d-1b08ed9e30f9 req-c55d9d73-cb2d-40f2-8877-86b962b78072 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-unplugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:39 user nova-compute[75257]: INFO os_vif [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fe:41,bridge_name='br-int',has_traffic_filtering=True,id=8a2fed29-201a-4e15-a780-532c03191f10,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2fed29-20')
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] No BDM found with device name hda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] No VIF found with MAC fa:16:3e:1a:2d:6a, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] No VIF found with MAC fa:16:3e:aa:3b:b0, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:09:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Using config drive
Nov 14 02:09:39 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:39 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Took 1.31 seconds to deallocate network for instance.
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:40 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Creating config drive at /opt/stack/data/nova/instances/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/disk.config
Nov 14 02:09:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpymaa15i9 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:40 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpymaa15i9" returned: 0 in 0.065s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:40 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Took 1.64 seconds to deallocate network for instance.
Nov 14 02:09:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:40 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:09:40 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:09:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.151s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:40 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Deleted allocations for instance b950c25e-2910-4de3-a9fc-30e4091dfe19
Nov 14 02:09:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-377a1fd5-6a8b-4d2d-b30e-2a3182a41f1b tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "b950c25e-2910-4de3-a9fc-30e4091dfe19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:40 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:09:40 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:09:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:41 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Deleted allocations for instance 8de0ee5b-852a-4146-ba87-378181e1cfc4
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'flavor' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2fd8fd7e-03cf-480e-8d94-bae60a9cd3a8 tempest-TaggedAttachmentsTest-1006457440 tempest-TaggedAttachmentsTest-1006457440-project-member] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.960s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:41 user nova-compute[75257]: INFO nova.compute.manager [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Attaching volume 6a26d0df-3e86-4e5e-bd0d-5deae5534d5a to /dev/vdb
Nov 14 02:09:41 user nova-compute[75257]: DEBUG os_brick.utils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af51865-4e48-43b3-9c04-dd33a8c04ca3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b44df6a-af68-4e02-b2f2-9b0dba498ef7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0032512-011f-4ed2-9c0f-83b414aa33e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f97369-7cd9-4e1c-96a7-510bdeb9f6a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:41 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[373ee189-bd30-4bb6-8fa4-3afcfcb540a2]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG os_brick.utils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating existing volume attachment record: 9fd4c16d-e69c-4e19-abe1-67bbe0b73dfb {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Acquiring lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] Lock "8de0ee5b-852a-4146-ba87-378181e1cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] No waiting events found dispatching network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:41 user nova-compute[75257]: WARNING nova.compute.manager [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received unexpected event network-vif-plugged-f0fa855e-494f-4fb7-9c5b-2022578e7a9e for instance with vm_state deleted and task_state None.
Nov 14 02:09:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] [instance: b950c25e-2910-4de3-a9fc-30e4091dfe19] Received event network-vif-deleted-3ec017bb-c846-419e-a33f-860b071d3b18 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-7667568e-0ba4-4882-820b-2bd4f76ca272 req-4005b8f8-4f9d-47cc-b920-a8903f8df6e2 service nova] [instance: 8de0ee5b-852a-4146-ba87-378181e1cfc4] Received event network-vif-deleted-f0fa855e-494f-4fb7-9c5b-2022578e7a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:41 user nova-compute[75257]: WARNING nova.compute.manager [req-8bccf555-2b1b-415e-a4ee-e09f793b3435 req-7c009f6d-1f46-42a0-a045-df88f5f90b4b service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance with vm_state building and task_state spawning.
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:42 user nova-compute[75257]: WARNING nova.compute.manager [req-c2345641-f4ba-4a13-a629-1aa401ff31db req-e543bdd3-8bd2-450e-9ed6-abe274ba16bb service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a for instance with vm_state building and task_state spawning.
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG nova.objects.instance [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'flavor' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:43 user nova-compute[75257]: INFO nova.compute.manager [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Attaching volume f01f386a-4a49-4a3f-932c-f3bdd88a29a4 to /dev/vdb
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG os_brick.utils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dbc697-43ca-4998-8b8c-5d075ee64a38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2277976c-2527-4a77-a2cd-d4b0b7b35ef6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae8d125-f743-4c31-91a8-87bf6dc3502d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9212e4c4-4a7b-4902-a79b-95e911ea66c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:43 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddbf6ef-77f5-4e84-b2a8-6109afdc8be3]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG os_brick.utils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Updating existing volume attachment record: 22831918-6934-479c-b157-545f9c408b54 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received event network-changed-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Refreshing instance network info cache due to event network-changed-7946fb64-2722-4b7d-a7bc-5223ad6536e5. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] Acquiring lock "refresh_cache-1a6df88a-5599-4b10-917c-c3c0b009c3cb" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] Acquired lock "refresh_cache-1a6df88a-5599-4b10-917c-c3c0b009c3cb" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Refreshing network info cache for port 7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:44 user nova-compute[75257]: WARNING nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance with vm_state building and task_state spawning.
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:44 user nova-compute[75257]: WARNING nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 for instance with vm_state building and task_state spawning.
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:44 user nova-compute[75257]: WARNING nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 for instance with vm_state building and task_state spawning.
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:44 user nova-compute[75257]: WARNING nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance with vm_state building and task_state spawning.
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:44 user nova-compute[75257]: WARNING nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance with vm_state building and task_state spawning.
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:44 user nova-compute[75257]: WARNING nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance with vm_state building and task_state spawning.
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:44 user nova-compute[75257]: WARNING nova.compute.manager [req-d36998a8-9276-4673-9a2d-1e343c3f8e31 req-2b8a8674-f760-497a-924a-e3ca487d46e5 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance with vm_state building and task_state spawning.
Nov 14 02:09:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:44 user nova-compute[75257]: WARNING nova.compute.manager [req-39aad020-60a0-466f-9323-9f603e155add req-bcb91331-5eda-48cb-a7b3-edf9e8b6cee9 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a for instance with vm_state building and task_state spawning.
Nov 14 02:09:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.network.neutron [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Updated VIF entry in instance network info cache for port 7946fb64-2722-4b7d-a7bc-5223ad6536e5. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG nova.network.neutron [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Updating instance_info_cache with network_info: [{"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4fe91e7b-5f80-465e-a007-0bfb25e491b7 req-52c1aa9f-9173-4c6d-a362-032595788b44 service nova] Releasing lock "refresh_cache-1a6df88a-5599-4b10-917c-c3c0b009c3cb" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:09:45 user nova-compute[75257]: INFO nova.compute.claims [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Claim successful on node user
Nov 14 02:09:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:45 user nova-compute[75257]: WARNING nova.compute.manager [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance with vm_state building and task_state spawning.
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:45 user nova-compute[75257]: WARNING nova.compute.manager [req-803e14e5-dbc4-482b-a14b-6f4835fe5e90 req-d8e4225d-4813-4bf9-b4d9-9fced7e5d843 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance with vm_state building and task_state spawning.
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:09:45 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:09:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.policy [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:09:45 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Creating image(s)
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:09:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance spawned successfully.
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:46 user nova-compute[75257]: WARNING nova.compute.manager [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-8a2fed29-201a-4e15-a780-532c03191f10 for instance with vm_state building and task_state spawning.
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:46 user nova-compute[75257]: WARNING nova.compute.manager [req-f94f1809-3a4e-4e4b-9332-4a3b8030507e req-5c532619-d7da-4cad-83d2-bf56b70868ae service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-8a2fed29-201a-4e15-a780-532c03191f10 for instance with vm_state building and task_state spawning.
Nov 14 02:09:46 user nova-compute[75257]: INFO nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Took 11.72 seconds to spawn the instance on the hypervisor.
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.215s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: INFO nova.compute.manager [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Took 27.31 seconds to build instance.
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-262d93b2-3227-4063-be4d-01d54278c435 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.419s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk 1073741824" returned: 0 in 0.052s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.201s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.network.neutron [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Successfully created port: 6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLfdnmiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:46 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:46 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:46 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb831a21-21ce-4622-b69d-514bfb13b5f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:09:46 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5907d8-ff3a-4598-a653-2d9bbff635a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a] added
Nov 14 02:09:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c3c0b4-0b7f-44e5-8f5e-71bf92ca1e26]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Cannot resize image /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Ensure instance console log exists: /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd3e45b-a516-4c20-9292-e150b5a5dbcf]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLfdnmiR {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLfdnmiR" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6525ba-b739-48a5-a3a3-e0cc2f095f51]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WLfdnmiR'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a0e683-7cc2-456c-9fd2-2d959ad127b4]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1db4c3-e6dd-444d-a470-f6e90d6604e6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:46 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:46 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:46 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:46 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:46 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:46 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:46 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:46 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6fada8-7007-4917-ba41-1ae9266443cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a, portal: 172.16.0.220,3260]
Nov 14 02:09:46 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a, portal: 172.16.0.220,3260] successful.
Nov 14 02:09:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11cc28c-98d7-400b-afd2-b615dc24c265]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cb2d54-45b4-4d37-9dbb-35d1574c0eb7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:47 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] HCTL ('38', '-', '-', 0) found on session 16 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7354bd-c212-4f25-9108-970f1b21e62d]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Searching for a device in session 16 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLfdnmiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Successfully updated port: 6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "refresh_cache-b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquired lock "refresh_cache-b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-changed-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Refreshing instance network info cache due to event network-changed-6e7908eb-09c1-4662-b587-2a28838e6ca6. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] Acquiring lock "refresh_cache-b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Updating instance_info_cache with network_info: [{"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Releasing lock "refresh_cache-b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Instance network_info: |[{"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] Acquired lock "refresh_cache-b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.network.neutron [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Refreshing network info cache for port 6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Start _get_guest_xml network_info=[{"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:09:47 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:47 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1741521006',display_name='tempest-tempest.common.compute-instance-1741521006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1741521006',id=15,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvMChb+aecwn40wfnvjF+Z4X1IXJnC2lqu7jzDw+N4Tyc9AiF8NWxVLA5y/hDnNYJ0o67tDS/YoN1aso6ftvlo/jonqLcgPcHXmzabpe0UOICeVkW5vaXUUBYQhWe3WJQ==',key_name='tempest-keypair-808543668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-t9n8uyh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.objects.instance [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'pci_devices' on Instance uuid b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:09:47 user nova-compute[75257]:   <uuid>b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146</uuid>
Nov 14 02:09:47 user nova-compute[75257]:   <name>instance-0000000f</name>
Nov 14 02:09:47 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:09:47 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:09:47 user nova-compute[75257]:   <metadata>
Nov 14 02:09:47 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:47 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:09:47 user nova-compute[75257]:       <nova:name>tempest-tempest.common.compute-instance-1741521006</nova:name>
Nov 14 02:09:47 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:09:47</nova:creationTime>
Nov 14 02:09:47 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:09:47 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:09:47 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:09:47 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:09:47 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:47 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:47 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:09:47 user nova-compute[75257]:       <nova:owner>
Nov 14 02:09:47 user nova-compute[75257]:         <nova:user uuid="7ffa5574e531479993ef301510f1d9e3">tempest-ServerActionsTestOtherA-1988221692-project-member</nova:user>
Nov 14 02:09:47 user nova-compute[75257]:         <nova:project uuid="a1ba9547629f4ea1b40424e277e17d25">tempest-ServerActionsTestOtherA-1988221692</nova:project>
Nov 14 02:09:47 user nova-compute[75257]:       </nova:owner>
Nov 14 02:09:47 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:47 user nova-compute[75257]:       <nova:ports>
Nov 14 02:09:47 user nova-compute[75257]:         <nova:port uuid="6e7908eb-09c1-4662-b587-2a28838e6ca6">
Nov 14 02:09:47 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 02:09:47 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:47 user nova-compute[75257]:       </nova:ports>
Nov 14 02:09:47 user nova-compute[75257]:     </nova:instance>
Nov 14 02:09:47 user nova-compute[75257]:   </metadata>
Nov 14 02:09:47 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:09:47 user nova-compute[75257]:     <system>
Nov 14 02:09:47 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:09:47 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:09:47 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:09:47 user nova-compute[75257]:       <entry name="serial">b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146</entry>
Nov 14 02:09:47 user nova-compute[75257]:       <entry name="uuid">b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146</entry>
Nov 14 02:09:47 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:09:47 user nova-compute[75257]:     </system>
Nov 14 02:09:47 user nova-compute[75257]:   </sysinfo>
Nov 14 02:09:47 user nova-compute[75257]:   <os>
Nov 14 02:09:47 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:09:47 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:09:47 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:09:47 user nova-compute[75257]:   </os>
Nov 14 02:09:47 user nova-compute[75257]:   <features>
Nov 14 02:09:47 user nova-compute[75257]:     <acpi/>
Nov 14 02:09:47 user nova-compute[75257]:     <apic/>
Nov 14 02:09:47 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:09:47 user nova-compute[75257]:   </features>
Nov 14 02:09:47 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:09:47 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:09:47 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:09:47 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:09:47 user nova-compute[75257]:   </clock>
Nov 14 02:09:47 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:09:47 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:09:47 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:09:47 user nova-compute[75257]:   </cpu>
Nov 14 02:09:47 user nova-compute[75257]:   <devices>
Nov 14 02:09:47 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:09:47 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:09:47 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk"/>
Nov 14 02:09:47 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:09:47 user nova-compute[75257]:     </disk>
Nov 14 02:09:47 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:47 user nova-compute[75257]:       <mac address="fa:16:3e:a5:e0:91"/>
Nov 14 02:09:47 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:47 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:47 user nova-compute[75257]:       <target dev="tap6e7908eb-09"/>
Nov 14 02:09:47 user nova-compute[75257]:     </interface>
Nov 14 02:09:47 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:09:47 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/console.log" append="off"/>
Nov 14 02:09:47 user nova-compute[75257]:     </serial>
Nov 14 02:09:47 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:09:47 user nova-compute[75257]:     <video>
Nov 14 02:09:47 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:47 user nova-compute[75257]:     </video>
Nov 14 02:09:47 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:09:47 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:09:47 user nova-compute[75257]:     </rng>
Nov 14 02:09:47 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:09:47 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:09:47 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:09:47 user nova-compute[75257]:     </memballoon>
Nov 14 02:09:47 user nova-compute[75257]:   </devices>
Nov 14 02:09:47 user nova-compute[75257]: </domain>
Nov 14 02:09:47 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1741521006',display_name='tempest-tempest.common.compute-instance-1741521006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1741521006',id=15,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvMChb+aecwn40wfnvjF+Z4X1IXJnC2lqu7jzDw+N4Tyc9AiF8NWxVLA5y/hDnNYJ0o67tDS/YoN1aso6ftvlo/jonqLcgPcHXmzabpe0UOICeVkW5vaXUUBYQhWe3WJQ==',key_name='tempest-keypair-808543668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-t9n8uyh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG os_vif [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d3f12bd-bee5-5b72-80ed-da91220f151f', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e7908eb-09, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e7908eb-09, col_values=(('qos', UUID('dfa750fa-1bf9-40f8-855c-a180b81e8d0f')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e7908eb-09, col_values=(('external_ids', {'iface-id': '6e7908eb-09c1-4662-b587-2a28838e6ca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:e0:91', 'vm-uuid': 'b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:48 user nova-compute[75257]: INFO os_vif [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09')
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23861313363326436', 'path': '/dev/sdg'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861313363326436', 'path': '/dev/sdg'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'flavor' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:09:48 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:09:48 user nova-compute[75257]:   <source dev="/dev/sdg"/>
Nov 14 02:09:48 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:09:48 user nova-compute[75257]:   <serial>6a26d0df-3e86-4e5e-bd0d-5deae5534d5a</serial>
Nov 14 02:09:48 user nova-compute[75257]: </disk>
Nov 14 02:09:48 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No VIF found with MAC fa:16:3e:a5:e0:91, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rdAvipBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:48 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:48 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:48 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0712da32-a669-472b-8bb2-179f6cc168da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:09:48 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be6f018-a999-4cf0-a636-91d594c4b60b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4] added
Nov 14 02:09:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0345492-c6c1-4c43-a8e6-d9707d2eec0e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd384d4a-62d2-412b-9207-324ede2abed1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rdAvipBa {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rdAvipBa" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4150ca-709f-45e3-8110-4144dbb6acbe]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rdAvipBa'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.network.neutron [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Updated VIF entry in instance network info cache for port 6e7908eb-09c1-4662-b587-2a28838e6ca6. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.network.neutron [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Updating instance_info_cache with network_info: [{"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9399891-7a88-4a5c-b456-3a87e1e3f99a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1ec54254-e740-4776-9931-7da16ba1827e req-9ad24c3c-f67c-44a5-b7c4-ac605df4c3be service nova] Releasing lock "refresh_cache-b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d249756-9266-4c5e-b540-f54ae3015bae]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquired lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'info_cache' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.objects.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c73d921-8eba-4c37-a764-28f070fd84c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4, portal: 172.16.0.220,3260]
Nov 14 02:09:48 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4, portal: 172.16.0.220,3260] successful.
Nov 14 02:09:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1d31d6-4d42-4ff8-8a2d-1678f515396e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffbcfda-d88d-48ea-b803-37542924c2cb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:48 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] HCTL ('39', '-', '-', 0) found on session 17 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] No VIF found with MAC fa:16:3e:88:71:d6, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443f606-6824-4f5e-9394-3f09749be1c2]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Searching for a device in session 17 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rdAvipBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8e579378-088f-4665-a8ea-5a3bc36a169f tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.432s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updating instance_info_cache with network_info: [{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Releasing lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance destroyed successfully.
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'resources' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.objects.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-437502509',display_name='tempest-AttachVolumeTestJSON-server-437502509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-437502509',id=2,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw==',key_name='tempest-keypair-94073184',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-k6t0eual',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=71a9d20f-e79b-4716-abf8-a15330742167,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_vif [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc019053-7c, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0643a472-7c69-4745-a02e-81f3c6e4c3d9) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:49 user nova-compute[75257]: INFO os_vif [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c')
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDKHQIqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:49 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:49 user nova-compute[75257]: INFO nova.compute.manager [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Rescuing
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquired lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23038313463376462', 'path': '/dev/sdh'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038313463376462', 'path': '/dev/sdh'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.553s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.objects.instance [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'flavor' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab48662-1622-4eb1-ae50-7f9af8190248]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:09:49 user nova-compute[75257]: No targets found.
Nov 14 02:09:49 user nova-compute[75257]: iSNS:
Nov 14 02:09:49 user nova-compute[75257]: No targets found.
Nov 14 02:09:49 user nova-compute[75257]: STATIC:
Nov 14 02:09:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93
Nov 14 02:09:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:09:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:09:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:09:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:09:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:09:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4
Nov 14 02:09:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:09:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:09:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7
Nov 14 02:09:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:09:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:09:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:09:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:09:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:09:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852
Nov 14 02:09:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:09:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:09:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f
Nov 14 02:09:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:09:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:09:49 user nova-compute[75257]: FIRMWARE:
Nov 14 02:09:49 user nova-compute[75257]: No targets found.
Nov 14 02:09:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:09:49 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:09:49 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:09:49 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:09:49 user nova-compute[75257]:   <source dev="/dev/sdh"/>
Nov 14 02:09:49 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:09:49 user nova-compute[75257]:   <serial>f01f386a-4a49-4a3f-932c-f3bdd88a29a4</serial>
Nov 14 02:09:49 user nova-compute[75257]: </disk>
Nov 14 02:09:49 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa636d2-892d-4954-83f9-e428f10bc43a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e159049-57f0-48bf-9f2d-676684c7e003]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:49 user nova-compute[75257]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c39c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb'): ({'sdd'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Removing single pathed devices sdd {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa16112-1c85-49e0-9798-d629ed4d3674]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a6207-fb59-4bde-92c7-aec2d657de30]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flushing IO for device /dev/sdd {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c750e-94e3-4714-bd60-87e076e50721]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3e055b-24e4-4e5b-884b-f4e1d712ac6e]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] SCSI volumes sdd have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Releasing lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a16f74-c73d-48f1-ba1d-edf2d9bcb341]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5faffa-7b37-4354-b023-9ca827c36dcc]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260]
Nov 14 02:09:49 user nova-compute[75257]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260] successful.
Nov 14 02:09:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e146bab8-8ed8-44c0-b1cb-175a5745a779]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.587s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== disconnect_volume: return (1141ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Start _get_guest_xml network_info=[{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c1bd7d32-7ca7-4e43-902f-aea0c3445d93', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDKHQIqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '71a9d20f-e79b-4716-abf8-a15330742167', 'attached_at': '', 'detached_at': '', 'volume_id': '399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 'serial': '399fd6d1-cc6f-432c-96c2-eb97da1c0ceb'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'numa_topology' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.objects.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] No VIF found with MAC fa:16:3e:55:56:65, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:09:50 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:50 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.objects.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDKHQIqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:50 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:50 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:50 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-unplugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-unplugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:50 user nova-compute[75257]: WARNING nova.compute.manager [req-7a5e9cd9-07a4-4e87-ba5f-25612e58efa4 req-3d577989-d0bd-44fd-af9d-9111e466a4e6 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-unplugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state active and task_state rescuing.
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf15f6b-9134-4311-b1ab-bd7c08f093ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:09:50 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e33d3c-d2e1-45a7-bda4-e797fca1e97c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb] added
Nov 14 02:09:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1745d73d-b4dd-4867-8081-762ff4163070]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0feb71-1810-481a-900e-88a28d5aa902]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDKHQIqE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-73e0554e-8098-4179-864c-c5d76db073cf tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.575s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDKHQIqE" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde2df71-cd18-49f9-81d4-9758bb5535dc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kDKHQIqE'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e03bb4-be69-44d2-a14b-6009e9b887eb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[14911769-1cf4-4adc-a78e-856431bc1428]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] No waiting events found dispatching network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:50 user nova-compute[75257]: WARNING nova.compute.manager [req-6304546d-914d-451a-8b68-80459a97b66a req-ebc4f15a-44e6-4f87-89d3-f20adc5ef00a service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received unexpected event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance with vm_state building and task_state spawning.
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea218f8-bfa5-41bb-8a5c-73ab33b6a1f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260]
Nov 14 02:09:50 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260] successful.
Nov 14 02:09:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[669afb04-c5a4-4a2a-ae69-ae05b038b450]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3da8de2-15ef-4f50-96bb-ca6a127956e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:50 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6b49df-2110-435d-a2eb-53d036c2b0d6]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:09:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDKHQIqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:09:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Instance destroyed successfully.
Nov 14 02:09:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Attempting a stable device rescue
Nov 14 02:09:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75257) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 02:09:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Instance directory exists: not creating {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 02:09:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Creating image(s)
Nov 14 02:09:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:51 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'trusted_certs' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "3d1ff3ee4fc4483ee163048e596e4be31d671520" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "3d1ff3ee4fc4483ee163048e596e4be31d671520" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.931s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== connect_volume: return (1934ms) {'type': 'block', 'scsi_wwn': '23936303438333237', 'path': '/dev/sdd'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936303438333237', 'path': '/dev/sdd'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-437502509',display_name='tempest-AttachVolumeTestJSON-server-437502509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-437502509',id=2,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw==',key_name='tempest-keypair-94073184',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-k6t0eual',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=71a9d20f-e79b-4716-abf8-a15330742167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'pci_devices' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.objects.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:09:52 user nova-compute[75257]:   <uuid>71a9d20f-e79b-4716-abf8-a15330742167</uuid>
Nov 14 02:09:52 user nova-compute[75257]:   <name>instance-00000002</name>
Nov 14 02:09:52 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:09:52 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:09:52 user nova-compute[75257]:   <metadata>
Nov 14 02:09:52 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:52 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:09:52 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeTestJSON-server-437502509</nova:name>
Nov 14 02:09:52 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:09:50</nova:creationTime>
Nov 14 02:09:52 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:09:52 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:09:52 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:09:52 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:09:52 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:52 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:52 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:09:52 user nova-compute[75257]:       <nova:owner>
Nov 14 02:09:52 user nova-compute[75257]:         <nova:user uuid="4002c20dcbc94a8ea540419f20f8621e">tempest-AttachVolumeTestJSON-1670713184-project-member</nova:user>
Nov 14 02:09:52 user nova-compute[75257]:         <nova:project uuid="246dd4dc2106412bb0ca5e71670d9557">tempest-AttachVolumeTestJSON-1670713184</nova:project>
Nov 14 02:09:52 user nova-compute[75257]:       </nova:owner>
Nov 14 02:09:52 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:52 user nova-compute[75257]:       <nova:ports>
Nov 14 02:09:52 user nova-compute[75257]:         <nova:port uuid="cc019053-7c21-4e5c-981e-389fe4a4beed">
Nov 14 02:09:52 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 02:09:52 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:52 user nova-compute[75257]:       </nova:ports>
Nov 14 02:09:52 user nova-compute[75257]:     </nova:instance>
Nov 14 02:09:52 user nova-compute[75257]:   </metadata>
Nov 14 02:09:52 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:09:52 user nova-compute[75257]:     <system>
Nov 14 02:09:52 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:09:52 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:09:52 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:09:52 user nova-compute[75257]:       <entry name="serial">71a9d20f-e79b-4716-abf8-a15330742167</entry>
Nov 14 02:09:52 user nova-compute[75257]:       <entry name="uuid">71a9d20f-e79b-4716-abf8-a15330742167</entry>
Nov 14 02:09:52 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:09:52 user nova-compute[75257]:     </system>
Nov 14 02:09:52 user nova-compute[75257]:   </sysinfo>
Nov 14 02:09:52 user nova-compute[75257]:   <os>
Nov 14 02:09:52 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:09:52 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:09:52 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:09:52 user nova-compute[75257]:   </os>
Nov 14 02:09:52 user nova-compute[75257]:   <features>
Nov 14 02:09:52 user nova-compute[75257]:     <acpi/>
Nov 14 02:09:52 user nova-compute[75257]:     <apic/>
Nov 14 02:09:52 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:09:52 user nova-compute[75257]:   </features>
Nov 14 02:09:52 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:09:52 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:09:52 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:09:52 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:09:52 user nova-compute[75257]:   </clock>
Nov 14 02:09:52 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:09:52 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:09:52 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:09:52 user nova-compute[75257]:   </cpu>
Nov 14 02:09:52 user nova-compute[75257]:   <devices>
Nov 14 02:09:52 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:09:52 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:09:52 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk"/>
Nov 14 02:09:52 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:09:52 user nova-compute[75257]:     </disk>
Nov 14 02:09:52 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:09:52 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:09:52 user nova-compute[75257]:       <source dev="/dev/sdd"/>
Nov 14 02:09:52 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:09:52 user nova-compute[75257]:       <serial>399fd6d1-cc6f-432c-96c2-eb97da1c0ceb</serial>
Nov 14 02:09:52 user nova-compute[75257]:     </disk>
Nov 14 02:09:52 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:52 user nova-compute[75257]:       <mac address="fa:16:3e:69:41:ac"/>
Nov 14 02:09:52 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:52 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:52 user nova-compute[75257]:       <target dev="tapcc019053-7c"/>
Nov 14 02:09:52 user nova-compute[75257]:     </interface>
Nov 14 02:09:52 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:09:52 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/console.log" append="off"/>
Nov 14 02:09:52 user nova-compute[75257]:     </serial>
Nov 14 02:09:52 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:09:52 user nova-compute[75257]:     <video>
Nov 14 02:09:52 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:52 user nova-compute[75257]:     </video>
Nov 14 02:09:52 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:09:52 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:09:52 user nova-compute[75257]:     </rng>
Nov 14 02:09:52 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:09:52 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:09:52 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:09:52 user nova-compute[75257]:     </memballoon>
Nov 14 02:09:52 user nova-compute[75257]:   </devices>
Nov 14 02:09:52 user nova-compute[75257]: </domain>
Nov 14 02:09:52 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520.part --force-share --output=json" returned: 0 in 0.211s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.virt.images [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] b509ff61-3da4-44ab-b845-45e446a66239 was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520.part /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:52 user nova-compute[75257]: WARNING nova.compute.manager [req-1f5d9f2d-7720-40c6-9eb0-191959fdc863 req-a129598d-446d-4b1e-8a95-1e0ad5876778 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state active and task_state rescuing.
Nov 14 02:09:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.465s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] No waiting events found dispatching network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:53 user nova-compute[75257]: WARNING nova.compute.manager [req-8fe6c413-5c4b-4f23-b8ca-b0c5169efcbf req-0dd9801c-80ae-443e-a1d3-f09b10a3549b service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received unexpected event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance with vm_state building and task_state spawning.
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'trusted_certs' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.objects.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:09:53 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Instance spawned successfully.
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.209s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520.part /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520.converted" returned: 0 in 0.925s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Cannot resize image /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'migration_context' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:53 user nova-compute[75257]: INFO nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Took 7.80 seconds to spawn the instance on the hypervisor.
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.objects.base [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-437502509',display_name='tempest-AttachVolumeTestJSON-server-437502509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-437502509',id=2,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw==',key_name='tempest-keypair-94073184',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-k6t0eual',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=71a9d20f-e79b-4716-abf8-a15330742167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG os_vif [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a61d4ccd-5716-5aa3-aa4c-ed448c97684b', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "3d1ff3ee4fc4483ee163048e596e4be31d671520" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.467s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "3d1ff3ee4fc4483ee163048e596e4be31d671520" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "3d1ff3ee4fc4483ee163048e596e4be31d671520" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc019053-7c, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc019053-7c, col_values=(('qos', UUID('ce0bf627-a656-4fb3-b347-af97aea52ea9')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc019053-7c, col_values=(('external_ids', {'iface-id': 'cc019053-7c21-4e5c-981e-389fe4a4beed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:41:ac', 'vm-uuid': '71a9d20f-e79b-4716-abf8-a15330742167'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:53 user nova-compute[75257]: INFO os_vif [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c')
Nov 14 02:09:53 user nova-compute[75257]: INFO nova.compute.manager [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Took 8.79 seconds to build instance.
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-69efb02b-c25c-44c7-826b-ce162f874ca1 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.905s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520 --force-share --output=json" returned: 0 in 0.208s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520,backing_fmt=raw /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520,backing_fmt=raw /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue" returned: 0 in 0.086s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "3d1ff3ee4fc4483ee163048e596e4be31d671520" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'migration_context' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Object Instance<b9b5a6d0-1304-49c1-90fb-5964d56885c8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Start _get_guest_xml network_info=[{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "vif_mac": "fa:16:3e:88:71:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b509ff61-3da4-44ab-b845-45e446a66239', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9fd4c16d-e69c-4e19-abe1-67bbe0b73dfb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLfdnmiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'b9b5a6d0-1304-49c1-90fb-5964d56885c8', 'attached_at': '', 'detached_at': '', 'volume_id': '6a26d0df-3e86-4e5e-bd0d-5deae5534d5a', 'serial': '6a26d0df-3e86-4e5e-bd0d-5deae5534d5a'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'resources' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Object Instance<b9b5a6d0-1304-49c1-90fb-5964d56885c8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'numa_topology' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Object Instance<b9b5a6d0-1304-49c1-90fb-5964d56885c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'vcpu_model' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Object Instance<b9b5a6d0-1304-49c1-90fb-5964d56885c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLfdnmiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:54 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:54 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:09:54 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb70203-cb3d-411d-817b-522b10acf3da]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WLfdnmiR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 02:09:54 user nova-compute[75257]: node.name = iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:09:54 user nova-compute[75257]: node.tpgt = -1
Nov 14 02:09:54 user nova-compute[75257]: node.startup = automatic
Nov 14 02:09:54 user nova-compute[75257]: node.leading_login = No
Nov 14 02:09:54 user nova-compute[75257]: iface.iscsi_ifacename = default
Nov 14 02:09:54 user nova-compute[75257]: iface.net_ifacename = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.ipaddress = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.prefix_len = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.hwaddress = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.transport_name = tcp
Nov 14 02:09:54 user nova-compute[75257]: iface.initiatorname = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.state = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.vlan_id = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.vlan_priority = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.vlan_state = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.iface_num = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.mtu = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.port = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.bootproto = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.subnet_mask = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.gateway = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.dhcp_alt_client_id = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.dhcp_dns = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.dhcp_learn_iqn = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.dhcp_vendor_id_state = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.dhcp_vendor_id = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.dhcp_slp_da = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.fragmentation = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.gratuitous_arp = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.incoming_forwarding = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.tos_state = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.tos = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.ttl = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.delayed_ack = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.tcp_nagle = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.tcp_wsf_state = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.tcp_wsf = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.tcp_timer_scale = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.tcp_timestamp = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.redirect = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.def_task_mgmt_timeout = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.header_digest = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.data_digest = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.immediate_data = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.initial_r2t = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.data_seq_inorder = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.data_pdu_inorder = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.erl = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.max_receive_data_len = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.first_burst_len = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.max_outstanding_r2t = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.max_burst_len = 0
Nov 14 02:09:54 user nova-compute[75257]: iface.chap_auth = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.bidi_chap = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.strict_login_compliance = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.discovery_auth = <empty>
Nov 14 02:09:54 user nova-compute[75257]: iface.discovery_logout = <empty>
Nov 14 02:09:54 user nova-compute[75257]: node.discovery_address = <empty>
Nov 14 02:09:54 user nova-compute[75257]: node.discovery_port = 0
Nov 14 02:09:54 user nova-compute[75257]: node.discovery_type = static
Nov 14 02:09:54 user nova-compute[75257]: node.session.initial_cmdsn = 0
Nov 14 02:09:54 user nova-compute[75257]: node.session.initial_login_retry_max = 8
Nov 14 02:09:54 user nova-compute[75257]: node.session.xmit_thread_priority = -20
Nov 14 02:09:54 user nova-compute[75257]: node.session.cmds_max = 128
Nov 14 02:09:54 user nova-compute[75257]: node.session.queue_depth = 32
Nov 14 02:09:54 user nova-compute[75257]: node.session.nr_sessions = 1
Nov 14 02:09:54 user nova-compute[75257]: node.session.auth.authmethod = CHAP
Nov 14 02:09:54 user nova-compute[75257]: node.session.auth.username = WLfdnmiR
Nov 14 02:09:54 user nova-compute[75257]: node.session.auth.password = ***
Nov 14 02:09:54 user nova-compute[75257]: node.session.auth.username_in = <empty>
Nov 14 02:09:54 user nova-compute[75257]: node.session.auth.password_in = <empty>
Nov 14 02:09:54 user nova-compute[75257]: node.session.auth.chap_algs = MD5
Nov 14 02:09:54 user nova-compute[75257]: node.session.timeo.replacement_timeout = 120
Nov 14 02:09:54 user nova-compute[75257]: node.session.err_timeo.abort_timeout = 15
Nov 14 02:09:54 user nova-compute[75257]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 02:09:54 user nova-compute[75257]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 02:09:54 user nova-compute[75257]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.FastAbort = Yes
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.InitialR2T = No
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.ImmediateData = Yes
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.MaxConnections = 1
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 02:09:54 user nova-compute[75257]: node.session.iscsi.ERL = 0
Nov 14 02:09:54 user nova-compute[75257]: node.session.scan = manual
Nov 14 02:09:54 user nova-compute[75257]: node.session.reopen_max = 0
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].address = 172.16.0.220
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].port = 3260
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].startup = manual
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].tcp.window_size = 524288
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].tcp.type_of_service = 0
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].timeo.logout_timeout = 15
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].timeo.login_timeout = 15
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].timeo.auth_timeout = 45
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].iscsi.DataDigest = None
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].iscsi.IFMarker = No
Nov 14 02:09:54 user nova-compute[75257]: node.conn[0].iscsi.OFMarker = No
Nov 14 02:09:54 user nova-compute[75257]: # END RECORD
Nov 14 02:09:54 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c4810a-ecbb-4358-9ad0-d969ef0ff43a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbf8109-56cc-449e-a0b6-39ade422da62]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLfdnmiR {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLfdnmiR" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[95473906-8846-41c4-be70-512a25c36e8c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WLfdnmiR'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0edbaca-c794-4dc1-9d43-edfe2c173a24]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec5628a-872a-4f0b-8042-6b0bec184e41]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:54 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:09:54 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:09:54 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] HCTL ('38', '0', '0', 0) found on session 16 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[918e8edf-3e7a-4516-8b5a-cb1aaf95cbd5]: (4, ('0 0 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Searching for a device in session 16 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLfdnmiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.208s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '23861313363326436', 'path': '/dev/sdg'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861313363326436', 'path': '/dev/sdg'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1579375628',display_name='tempest-ServerStableDeviceRescueTest-server-1579375628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1579375628',id=4,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq7oRF6OXXfz/US7S5M/p/e15didQje182FxTBE9gXxDXx7o0EBCTENzobqIRSryWT181xbmOLIIMJAJVc0DG69fsUd13H6dI+0Clcf6sFNLQBtvOE6JrQMPFfhuLmNrg==',key_name='tempest-keypair-1863826463',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c82a8c1198544448e57221af68aa01e',ramdisk_id='',reservation_id='r-b9n4kmvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2053742251',owner_user_name='tempest-ServerStableDeviceRescueTest-2053742251-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='684b5b76244349489205840fb9b4e39d',uuid=b9b5a6d0-1304-49c1-90fb-5964d56885c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "vif_mac": "fa:16:3e:88:71:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Converting VIF {"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "vif_mac": "fa:16:3e:88:71:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:71:d6,bridge_name='br-int',has_traffic_filtering=True,id=8fe0bc37-945a-433d-8dd0-43514dce6f99,network=Network(5919d81b-1969-4559-82b3-6497f0571caa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe0bc37-94') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'pci_devices' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Object Instance<b9b5a6d0-1304-49c1-90fb-5964d56885c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:09:54 user nova-compute[75257]:   <uuid>b9b5a6d0-1304-49c1-90fb-5964d56885c8</uuid>
Nov 14 02:09:54 user nova-compute[75257]:   <name>instance-00000004</name>
Nov 14 02:09:54 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:09:54 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:09:54 user nova-compute[75257]:   <metadata>
Nov 14 02:09:54 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:09:54 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:09:54 user nova-compute[75257]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1579375628</nova:name>
Nov 14 02:09:54 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:09:54</nova:creationTime>
Nov 14 02:09:54 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:09:54 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:09:54 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:09:54 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:09:54 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:09:54 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:09:54 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:09:54 user nova-compute[75257]:       <nova:owner>
Nov 14 02:09:54 user nova-compute[75257]:         <nova:user uuid="684b5b76244349489205840fb9b4e39d">tempest-ServerStableDeviceRescueTest-2053742251-project-member</nova:user>
Nov 14 02:09:54 user nova-compute[75257]:         <nova:project uuid="3c82a8c1198544448e57221af68aa01e">tempest-ServerStableDeviceRescueTest-2053742251</nova:project>
Nov 14 02:09:54 user nova-compute[75257]:       </nova:owner>
Nov 14 02:09:54 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:09:54 user nova-compute[75257]:       <nova:ports>
Nov 14 02:09:54 user nova-compute[75257]:         <nova:port uuid="8fe0bc37-945a-433d-8dd0-43514dce6f99">
Nov 14 02:09:54 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 02:09:54 user nova-compute[75257]:         </nova:port>
Nov 14 02:09:54 user nova-compute[75257]:       </nova:ports>
Nov 14 02:09:54 user nova-compute[75257]:     </nova:instance>
Nov 14 02:09:54 user nova-compute[75257]:   </metadata>
Nov 14 02:09:54 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:09:54 user nova-compute[75257]:     <system>
Nov 14 02:09:54 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:09:54 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:09:54 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:09:54 user nova-compute[75257]:       <entry name="serial">b9b5a6d0-1304-49c1-90fb-5964d56885c8</entry>
Nov 14 02:09:54 user nova-compute[75257]:       <entry name="uuid">b9b5a6d0-1304-49c1-90fb-5964d56885c8</entry>
Nov 14 02:09:54 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:09:54 user nova-compute[75257]:     </system>
Nov 14 02:09:54 user nova-compute[75257]:   </sysinfo>
Nov 14 02:09:54 user nova-compute[75257]:   <os>
Nov 14 02:09:54 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:09:54 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:09:54 user nova-compute[75257]:   </os>
Nov 14 02:09:54 user nova-compute[75257]:   <features>
Nov 14 02:09:54 user nova-compute[75257]:     <acpi/>
Nov 14 02:09:54 user nova-compute[75257]:     <apic/>
Nov 14 02:09:54 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:09:54 user nova-compute[75257]:   </features>
Nov 14 02:09:54 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:09:54 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:09:54 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:09:54 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:09:54 user nova-compute[75257]:   </clock>
Nov 14 02:09:54 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:09:54 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:09:54 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:09:54 user nova-compute[75257]:   </cpu>
Nov 14 02:09:54 user nova-compute[75257]:   <devices>
Nov 14 02:09:54 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:09:54 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:09:54 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk"/>
Nov 14 02:09:54 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:09:54 user nova-compute[75257]:     </disk>
Nov 14 02:09:54 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:09:54 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:09:54 user nova-compute[75257]:       <source dev="/dev/sdg"/>
Nov 14 02:09:54 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:09:54 user nova-compute[75257]:       <serial>6a26d0df-3e86-4e5e-bd0d-5deae5534d5a</serial>
Nov 14 02:09:54 user nova-compute[75257]:     </disk>
Nov 14 02:09:54 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:09:54 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:09:54 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue"/>
Nov 14 02:09:54 user nova-compute[75257]:       <target dev="vdc" bus="virtio"/>
Nov 14 02:09:54 user nova-compute[75257]:       <boot order="1"/>
Nov 14 02:09:54 user nova-compute[75257]:     </disk>
Nov 14 02:09:54 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:09:54 user nova-compute[75257]:       <mac address="fa:16:3e:88:71:d6"/>
Nov 14 02:09:54 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:54 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:09:54 user nova-compute[75257]:       <target dev="tap8fe0bc37-94"/>
Nov 14 02:09:54 user nova-compute[75257]:     </interface>
Nov 14 02:09:54 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:09:54 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/console.log" append="off"/>
Nov 14 02:09:54 user nova-compute[75257]:     </serial>
Nov 14 02:09:54 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:09:54 user nova-compute[75257]:     <video>
Nov 14 02:09:54 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:09:54 user nova-compute[75257]:     </video>
Nov 14 02:09:54 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:09:54 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:09:54 user nova-compute[75257]:     </rng>
Nov 14 02:09:54 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:09:54 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:09:54 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:09:54 user nova-compute[75257]:     </memballoon>
Nov 14 02:09:54 user nova-compute[75257]:   </devices>
Nov 14 02:09:54 user nova-compute[75257]: </domain>
Nov 14 02:09:54 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:09:54 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Instance destroyed successfully.
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:09:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] No VIF found with MAC fa:16:3e:88:71:d6, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'flavor' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:55 user nova-compute[75257]: INFO nova.compute.manager [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Attaching volume 27360132-699a-4854-96d9-cb7a7936f337 to /dev/vdc
Nov 14 02:09:55 user nova-compute[75257]: DEBUG os_brick.utils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[30faf23a-ca8e-48ca-8821-275e9f1417c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[846b47f3-dbb8-4e9d-b459-cedf054cbf63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9060756-e406-4993-b902-40f0bc14509b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c939e8ed-50d5-4b55-9627-a5938106e3ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:09:55 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:09:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a756996d-611d-4859-bf6d-baba3b02e415]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG os_brick.utils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Updating existing volume attachment record: ac75d9b1-9ed8-4901-bc9d-0201655bbbbf {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG nova.compute.manager [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG nova.compute.manager [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:56 user nova-compute[75257]: WARNING nova.compute.manager [req-9753fb65-1fdc-4eb5-a5a4-91243ae2e233 req-f1f396be-d56f-4a14-aef3-5f30e0e7e59c service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state stopped and task_state powering-on.
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:58 user nova-compute[75257]: WARNING nova.compute.manager [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state stopped and task_state powering-on.
Nov 14 02:09:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:58 user nova-compute[75257]: WARNING nova.compute.manager [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state active and task_state rescuing.
Nov 14 02:09:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:09:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:09:58 user nova-compute[75257]: WARNING nova.compute.manager [req-b058a969-ab97-41cb-b6c0-c3a8eacd8551 req-8520e74e-fc81-4211-8330-3e53096c5d8c service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state active and task_state rescuing.
Nov 14 02:09:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:09:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:09:59 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance rebooted successfully.
Nov 14 02:09:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ca7c1b4d-c299-4dd4-b945-f44c56c16280 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:09:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e016eb21-7cca-4b1a-8642-38fa0c671e22 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCgGDOrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:10:01 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:10:01 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:10:01 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[36edfa5c-a504-4109-aa54-a302e8cc101d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:10:01 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a361356-1b81-4f33-9b4e-b7e50e1bb009]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337] added
Nov 14 02:10:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccecf9b1-c907-47a1-921b-9fc8388cb0dc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7967792-0939-4ea8-9b78-801dfb0b8cc9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCgGDOrB {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCgGDOrB" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f5fe51-9078-4325-a3c2-45cb1814c427]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NCgGDOrB'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.046s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cfc1e8-cdc1-4e28-b758-94524bf5e4c6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cf4f59-2f8c-40bf-b658-0a15b18e0b3a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:10:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:10:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4f010c-dc64-4540-8db4-a069bb4c18c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337, portal: 172.16.0.220,3260]
Nov 14 02:10:01 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337, portal: 172.16.0.220,3260] successful.
Nov 14 02:10:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb5acd0-2ff5-4eb1-bc52-0c6b4ec43dea]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[55779dd8-5274-4215-9a8d-302323f3c324]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:10:01 user nova-compute[75257]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 (non-flash)
Nov 14 02:10:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e908f593-a99c-4aaf-b150-5bcaa17e14cf]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:10:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCgGDOrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:10:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:10:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26237656434656236', 'path': '/dev/sdi'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:10:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237656434656236', 'path': '/dev/sdi'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:10:02 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'flavor' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:10:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:10:02 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:10:02 user nova-compute[75257]:   <source dev="/dev/sdi"/>
Nov 14 02:10:02 user nova-compute[75257]:   <target dev="vdc" bus="virtio"/>
Nov 14 02:10:02 user nova-compute[75257]:   <serial>27360132-699a-4854-96d9-cb7a7936f337</serial>
Nov 14 02:10:02 user nova-compute[75257]: </disk>
Nov 14 02:10:02 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:10:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:02 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:10:03 user nova-compute[75257]: INFO nova.compute.claims [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Claim successful on node user
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] No VIF found with MAC fa:16:3e:55:56:65, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2794684a-7cc0-4c8c-b24e-61d994a5485d tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.318s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:10:03 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:10:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:10:03 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Creating image(s)
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "/opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "/opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "/opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG nova.policy [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '817e73cf3aab4227baee2a818261aa41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ac0058ef794b9b860bf77eec4e6ac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:10:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.217s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.212s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk 1073741824" returned: 0 in 0.066s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:10:04 user nova-compute[75257]: INFO nova.compute.manager [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Detaching volume 27360132-699a-4854-96d9-cb7a7936f337
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:04 user nova-compute[75257]: INFO nova.virt.block_device [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Attempting to driver detach volume 27360132-699a-4854-96d9-cb7a7936f337 from mountpoint /dev/vdc
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.298s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Successfully created port: 4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Attempting to detach device vdc from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:10:04 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:10:04 user nova-compute[75257]:   <source dev="/dev/sdi"/>
Nov 14 02:10:04 user nova-compute[75257]:   <target dev="vdc" bus="virtio"/>
Nov 14 02:10:04 user nova-compute[75257]:   <serial>27360132-699a-4854-96d9-cb7a7936f337</serial>
Nov 14 02:10:04 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 02:10:04 user nova-compute[75257]: </disk>
Nov 14 02:10:04 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:10:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Successfully detached device vdc from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb from the persistent domain config.
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:10:04 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:10:04 user nova-compute[75257]:   <source dev="/dev/sdi"/>
Nov 14 02:10:04 user nova-compute[75257]:   <target dev="vdc" bus="virtio"/>
Nov 14 02:10:04 user nova-compute[75257]:   <serial>27360132-699a-4854-96d9-cb7a7936f337</serial>
Nov 14 02:10:04 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 02:10:04 user nova-compute[75257]: </disk>
Nov 14 02:10:04 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Cannot resize image /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Ensure instance console log exists: /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Successfully updated port: 4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "refresh_cache-d89aad70-7a33-4519-8308-f9ed98031692" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquired lock "refresh_cache-d89aad70-7a33-4519-8308-f9ed98031692" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received event network-changed-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Refreshing instance network info cache due to event network-changed-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] Acquiring lock "refresh_cache-d89aad70-7a33-4519-8308-f9ed98031692" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:10:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Updating instance_info_cache with network_info: [{"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Releasing lock "refresh_cache-d89aad70-7a33-4519-8308-f9ed98031692" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Instance network_info: |[{"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] Acquired lock "refresh_cache-d89aad70-7a33-4519-8308-f9ed98031692" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Refreshing network info cache for port 4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Start _get_guest_xml network_info=[{"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:06 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:10:06 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-405678036',display_name='tempest-TestVolumeSwap-server-405678036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-405678036',id=16,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7RzV/4Ypkr9Ux4gBjv/6XnOLctGJvPbC68tHH5zEAYEzzHjvU9DI9lPLMmf+YRNz+/cZcpYDl9EEuPGW0KMFdut0kCse1RyMksPvsUw7Fgv3s1R4iIdE2/n+CMGHHu3g==',key_name='tempest-keypair-343931820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94ac0058ef794b9b860bf77eec4e6ac0',ramdisk_id='',reservation_id='r-vt4o6dh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-3367491',owner_user_name='tempest-TestVolumeSwap-3367491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:10:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='817e73cf3aab4227baee2a818261aa41',uuid=d89aad70-7a33-4519-8308-f9ed98031692,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Converting VIF {"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:d3:97,bridge_name='br-int',has_traffic_filtering=True,id=4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084,network=Network(a1a582cc-802d-4caa-b01e-3ee12453e79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8ac591-92') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lazy-loading 'pci_devices' on Instance uuid d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:10:06 user nova-compute[75257]:   <uuid>d89aad70-7a33-4519-8308-f9ed98031692</uuid>
Nov 14 02:10:06 user nova-compute[75257]:   <name>instance-00000010</name>
Nov 14 02:10:06 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:10:06 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:10:06 user nova-compute[75257]:   <metadata>
Nov 14 02:10:06 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:10:06 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:10:06 user nova-compute[75257]:       <nova:name>tempest-TestVolumeSwap-server-405678036</nova:name>
Nov 14 02:10:06 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:10:06</nova:creationTime>
Nov 14 02:10:06 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:10:06 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:10:06 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:10:06 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:10:06 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:10:06 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:10:06 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:10:06 user nova-compute[75257]:       <nova:owner>
Nov 14 02:10:06 user nova-compute[75257]:         <nova:user uuid="817e73cf3aab4227baee2a818261aa41">tempest-TestVolumeSwap-3367491-project-member</nova:user>
Nov 14 02:10:06 user nova-compute[75257]:         <nova:project uuid="94ac0058ef794b9b860bf77eec4e6ac0">tempest-TestVolumeSwap-3367491</nova:project>
Nov 14 02:10:06 user nova-compute[75257]:       </nova:owner>
Nov 14 02:10:06 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:10:06 user nova-compute[75257]:       <nova:ports>
Nov 14 02:10:06 user nova-compute[75257]:         <nova:port uuid="4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084">
Nov 14 02:10:06 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 02:10:06 user nova-compute[75257]:         </nova:port>
Nov 14 02:10:06 user nova-compute[75257]:       </nova:ports>
Nov 14 02:10:06 user nova-compute[75257]:     </nova:instance>
Nov 14 02:10:06 user nova-compute[75257]:   </metadata>
Nov 14 02:10:06 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:10:06 user nova-compute[75257]:     <system>
Nov 14 02:10:06 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:10:06 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:10:06 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:10:06 user nova-compute[75257]:       <entry name="serial">d89aad70-7a33-4519-8308-f9ed98031692</entry>
Nov 14 02:10:06 user nova-compute[75257]:       <entry name="uuid">d89aad70-7a33-4519-8308-f9ed98031692</entry>
Nov 14 02:10:06 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:10:06 user nova-compute[75257]:     </system>
Nov 14 02:10:06 user nova-compute[75257]:   </sysinfo>
Nov 14 02:10:06 user nova-compute[75257]:   <os>
Nov 14 02:10:06 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:10:06 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:10:06 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:10:06 user nova-compute[75257]:   </os>
Nov 14 02:10:06 user nova-compute[75257]:   <features>
Nov 14 02:10:06 user nova-compute[75257]:     <acpi/>
Nov 14 02:10:06 user nova-compute[75257]:     <apic/>
Nov 14 02:10:06 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:10:06 user nova-compute[75257]:   </features>
Nov 14 02:10:06 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:10:06 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:10:06 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:10:06 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:10:06 user nova-compute[75257]:   </clock>
Nov 14 02:10:06 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:10:06 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:10:06 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:10:06 user nova-compute[75257]:   </cpu>
Nov 14 02:10:06 user nova-compute[75257]:   <devices>
Nov 14 02:10:06 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:10:06 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:10:06 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk"/>
Nov 14 02:10:06 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:10:06 user nova-compute[75257]:     </disk>
Nov 14 02:10:06 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:10:06 user nova-compute[75257]:       <mac address="fa:16:3e:60:d3:97"/>
Nov 14 02:10:06 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:10:06 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:10:06 user nova-compute[75257]:       <target dev="tap4c8ac591-92"/>
Nov 14 02:10:06 user nova-compute[75257]:     </interface>
Nov 14 02:10:06 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:10:06 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/console.log" append="off"/>
Nov 14 02:10:06 user nova-compute[75257]:     </serial>
Nov 14 02:10:06 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:10:06 user nova-compute[75257]:     <video>
Nov 14 02:10:06 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:10:06 user nova-compute[75257]:     </video>
Nov 14 02:10:06 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:10:06 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:10:06 user nova-compute[75257]:     </rng>
Nov 14 02:10:06 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:10:06 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:10:06 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:10:06 user nova-compute[75257]:     </memballoon>
Nov 14 02:10:06 user nova-compute[75257]:   </devices>
Nov 14 02:10:06 user nova-compute[75257]: </domain>
Nov 14 02:10:06 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-405678036',display_name='tempest-TestVolumeSwap-server-405678036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-405678036',id=16,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7RzV/4Ypkr9Ux4gBjv/6XnOLctGJvPbC68tHH5zEAYEzzHjvU9DI9lPLMmf+YRNz+/cZcpYDl9EEuPGW0KMFdut0kCse1RyMksPvsUw7Fgv3s1R4iIdE2/n+CMGHHu3g==',key_name='tempest-keypair-343931820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94ac0058ef794b9b860bf77eec4e6ac0',ramdisk_id='',reservation_id='r-vt4o6dh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-3367491',owner_user_name='tempest-TestVolumeSwap-3367491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:10:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='817e73cf3aab4227baee2a818261aa41',uuid=d89aad70-7a33-4519-8308-f9ed98031692,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Converting VIF {"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:d3:97,bridge_name='br-int',has_traffic_filtering=True,id=4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084,network=Network(a1a582cc-802d-4caa-b01e-3ee12453e79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8ac591-92') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG os_vif [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:d3:97,bridge_name='br-int',has_traffic_filtering=True,id=4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084,network=Network(a1a582cc-802d-4caa-b01e-3ee12453e79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8ac591-92') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '129d4f7d-c358-5c05-8e23-b5d6f6efe384', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c8ac591-92, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c8ac591-92, col_values=(('qos', UUID('e21af307-0be0-4af1-9648-65f7c4f7e357')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c8ac591-92, col_values=(('external_ids', {'iface-id': '4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:d3:97', 'vm-uuid': 'd89aad70-7a33-4519-8308-f9ed98031692'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:06 user nova-compute[75257]: INFO os_vif [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:d3:97,bridge_name='br-int',has_traffic_filtering=True,id=4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084,network=Network(a1a582cc-802d-4caa-b01e-3ee12453e79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8ac591-92')
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] No VIF found with MAC fa:16:3e:60:d3:97, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Updated VIF entry in instance network info cache for port 4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Updating instance_info_cache with network_info: [{"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b0c4585-a6e3-47ab-acc0-2fa973c13774 req-cc8ab249-ae10-4b95-8da0-e7f24f31dc62 service nova] Releasing lock "refresh_cache-d89aad70-7a33-4519-8308-f9ed98031692" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:10:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received event network-vif-plugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] No waiting events found dispatching network-vif-plugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:10:10 user nova-compute[75257]: WARNING nova.compute.manager [req-5771f3df-dfa3-4e70-b32e-75324cdbf052 req-b3a09483-27f5-4ec2-ad9c-f4c0bcb303fa service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received unexpected event network-vif-plugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance with vm_state building and task_state spawning.
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received event network-vif-plugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] No waiting events found dispatching network-vif-plugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:10:10 user nova-compute[75257]: WARNING nova.compute.manager [req-e5f78578-1e83-4ea6-8553-e0f35c1a4bce req-ad0ad3a0-e72d-4ac8-8bd1-c761894c816f service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received unexpected event network-vif-plugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance with vm_state building and task_state spawning.
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:10:10 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:10:10 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7544MB free_disk=25.437328338623047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:10 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Instance spawned successfully.
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:10:10 user nova-compute[75257]: INFO nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 71a9d20f-e79b-4716-abf8-a15330742167 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2f9df98c-7814-419d-8821-d8c571972f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance fd62b270-19d7-45e5-bd66-a94c384050bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42d01836-ef5a-4dba-ab6a-49bfe7976879 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance d89aad70-7a33-4519-8308-f9ed98031692 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:10:11 user nova-compute[75257]: INFO nova.compute.manager [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Took 7.96 seconds to build instance.
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e27b819a-b153-494b-a87d-d9719cad6a37 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.098s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:11 user nova-compute[75257]: INFO nova.compute.manager [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Terminating instance
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.manager [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-unplugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.manager [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] No waiting events found dispatching network-vif-unplugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:10:11 user nova-compute[75257]: DEBUG nova.compute.manager [req-5ca90072-0e76-4f4b-b914-966dbad044f3 req-e2b7f3fd-83ec-4f23-bf24-2d34f1664591 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-unplugged-7c8790c5-8202-4e02-94e3-3581d766cc78 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:10:12 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Instance destroyed successfully.
Nov 14 02:10:12 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lazy-loading 'resources' on Instance uuid 42d01836-ef5a-4dba-ab6a-49bfe7976879 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1126017660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-830117018',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgf2fXbCY9rsjb34KMUST8SMXto50nACORXEnnMj+K0J2fgBaFnj6x23XOrkc5PvkSbOH/DwnZ6aLyMOr4VrPPGI6VOba5H/JsmvGMycdDB8yWuFuzI/QXeNX4GuWC8IA==',key_name='tempest-keypair-586767792',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:08:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91262b32dbc949beb98767d004ff9a73',ramdisk_id='',reservation_id='r-mljiki2r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-358377017',owner_user_name='tempest-ServerActionsV293TestJSON-358377017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67156afa3d24427e90e99f944362ecfe',uuid=42d01836-ef5a-4dba-ab6a-49bfe7976879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converting VIF {"id": "7c8790c5-8202-4e02-94e3-3581d766cc78", "address": "fa:16:3e:b4:04:3c", "network": {"id": "a89fe182-db5c-45d7-bf99-4b62526465e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1670512194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91262b32dbc949beb98767d004ff9a73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c8790c5-82", "ovs_interfaceid": "7c8790c5-8202-4e02-94e3-3581d766cc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_vif [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c8790c5-82, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff7ed5da-b5e7-4e3b-bc96-2b7fc34e0498) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:12 user nova-compute[75257]: INFO os_vif [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:04:3c,bridge_name='br-int',has_traffic_filtering=True,id=7c8790c5-8202-4e02-94e3-3581d766cc78,network=Network(a89fe182-db5c-45d7-bf99-4b62526465e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c8790c5-82')
Nov 14 02:10:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNrvPjld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:10:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a4b3c-9664-4238-84f5-02a84eb8d579]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:10:12 user nova-compute[75257]: No targets found.
Nov 14 02:10:12 user nova-compute[75257]: iSNS:
Nov 14 02:10:12 user nova-compute[75257]: No targets found.
Nov 14 02:10:12 user nova-compute[75257]: STATIC:
Nov 14 02:10:12 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93
Nov 14 02:10:12 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:12 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:12 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:10:12 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:12 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:12 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337
Nov 14 02:10:12 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:12 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:12 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4
Nov 14 02:10:12 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:12 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:12 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7
Nov 14 02:10:12 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:12 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:12 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:10:12 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:12 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:12 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852
Nov 14 02:10:12 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:12 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:12 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f
Nov 14 02:10:12 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:12 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:12 user nova-compute[75257]: FIRMWARE:
Nov 14 02:10:12 user nova-compute[75257]: No targets found.
Nov 14 02:10:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:10:12 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:10:12 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae3c574-aa02-4b5b-b61f-20546143f6f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afbe218-d0f8-4cf5-9820-45c57d876558]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:10:12 user nova-compute[75257]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 (non-flash)
Nov 14 02:10:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a58d7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d8dd1d-ed73-4045-ba60-085e1a38343c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eb197f-64f5-4d19-ab43-b49fad08f132]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc40936-d919-4e2d-961e-e5cc4f2bb05e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b79d8ea-925c-4e47-8a3d-e438c3f93279]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_39bb5ea9', '/dev/disk/by-id/scsi-1SCST_BIO39bb5ea9-6d786d7831db1573', '/dev/disk/by-id/scsi-23664373836643738') {{(pid=85764) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5896716f-1430-4dff-8051-b56ef8181f68]: (4, None) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1578eef-6d28-416c-b272-197a737121a9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be0ca18-f66f-4b73-a74c-07e939671133]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260]
Nov 14 02:10:12 user nova-compute[75257]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7, portal: 172.16.0.220,3260] successful.
Nov 14 02:10:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63a8b1e6-4579-48f6-8a4c-b75386826ce7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.096s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceed9646-3bbe-4fd4-a998-c18f4c3d0f88]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.497s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] <== disconnect_volume: return (500ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:10:12 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Deleting instance files /opt/stack/data/nova/instances/42d01836-ef5a-4dba-ab6a-49bfe7976879_del
Nov 14 02:10:12 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Deletion of /opt/stack/data/nova/instances/42d01836-ef5a-4dba-ab6a-49bfe7976879_del complete
Nov 14 02:10:12 user nova-compute[75257]: INFO nova.compute.manager [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 14 02:10:12 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:10:12 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:10:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:13 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:10:13 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Took 1.04 seconds to deallocate network for instance.
Nov 14 02:10:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:10:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] Acquiring lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] No waiting events found dispatching network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:10:13 user nova-compute[75257]: WARNING nova.compute.manager [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received unexpected event network-vif-plugged-7c8790c5-8202-4e02-94e3-3581d766cc78 for instance with vm_state active and task_state deleting.
Nov 14 02:10:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-28246616-0f49-4a3f-beea-e1b108123f6a req-5de9341f-d49a-44f6-9b27-a697875d5060 service nova] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Received event network-vif-deleted-7c8790c5-8202-4e02-94e3-3581d766cc78 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:10:14 user nova-compute[75257]: INFO nova.compute.manager [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Took 0.91 seconds to detach 1 volumes for instance.
Nov 14 02:10:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] [instance: 42d01836-ef5a-4dba-ab6a-49bfe7976879] Deleting volume: 63a8b1e6-4579-48f6-8a4c-b75386826ce7 {{(pid=75257) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 02:10:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:15 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:10:15 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:10:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:15 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Deleted allocations for instance 42d01836-ef5a-4dba-ab6a-49bfe7976879
Nov 14 02:10:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8d0630e0-c89d-44f8-86ed-695a51f0e6b4 tempest-ServerActionsV293TestJSON-358377017 tempest-ServerActionsV293TestJSON-358377017-project-member] Lock "42d01836-ef5a-4dba-ab6a-49bfe7976879" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.192s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:25 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb is timed out.
Nov 14 02:10:25 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Successfully detached device vdc from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb from the live domain config.
Nov 14 02:10:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCgGDOrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:10:25 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb30de1-65c4-46f4-991a-e3643113821d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:10:25 user nova-compute[75257]: No targets found.
Nov 14 02:10:25 user nova-compute[75257]: iSNS:
Nov 14 02:10:25 user nova-compute[75257]: No targets found.
Nov 14 02:10:25 user nova-compute[75257]: STATIC:
Nov 14 02:10:25 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93
Nov 14 02:10:25 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:25 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:25 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:10:25 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:25 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:25 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337
Nov 14 02:10:25 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:25 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:25 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4
Nov 14 02:10:25 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:25 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:25 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:10:25 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:25 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:25 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852
Nov 14 02:10:25 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:25 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:25 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f
Nov 14 02:10:25 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:10:25 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:10:25 user nova-compute[75257]: FIRMWARE:
Nov 14 02:10:25 user nova-compute[75257]: No targets found.
Nov 14 02:10:25 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:10:25 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:10:25 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b416a0-535b-4464-8ad5-9bf5059c4530]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b6d541-08fc-42fb-ba4e-c39095b9300e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 (non-flash)
Nov 14 02:10:25 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:10:25 user nova-compute[75257]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 (non-flash)
Nov 14 02:10:25 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3c9fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337'): ({'sdi'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Removing single pathed devices sdi {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c666b19-a511-4797-8092-46092723e417]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e26aea5-af11-4916-91c1-9b0543ca7662]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Flushing IO for device /dev/sdi {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f1f3d2-1406-46d5-8b93-cdc81f39657e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9018d81-3a66-445c-bbc4-0d9cf53552a8]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] SCSI volumes sdi have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338b2d3-6273-452b-af66-37ff6bb0300e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5337029-9098-41f4-bfe1-6524ae32539a]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337, portal: 172.16.0.220,3260]
Nov 14 02:10:25 user nova-compute[75257]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337, portal: 172.16.0.220,3260] successful.
Nov 14 02:10:25 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27360132-699a-4854-96d9-cb7a7936f337 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57db981-8f0a-4386-b7b1-41c565b8a48d]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] <== disconnect_volume: return (371ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:10:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:10:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:26 user nova-compute[75257]: DEBUG nova.objects.instance [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'flavor' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:10:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a1c7277c-41d2-4c4e-83b4-dc4b9e791a96 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.113s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:10:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:55 user nova-compute[75257]: INFO nova.compute.manager [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Detaching volume f01f386a-4a49-4a3f-932c-f3bdd88a29a4
Nov 14 02:10:55 user nova-compute[75257]: INFO nova.virt.block_device [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Attempting to driver detach volume f01f386a-4a49-4a3f-932c-f3bdd88a29a4 from mountpoint /dev/vdb
Nov 14 02:10:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Attempting to detach device vdb from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:10:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:10:55 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:10:55 user nova-compute[75257]:   <source dev="/dev/sdh"/>
Nov 14 02:10:55 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:10:55 user nova-compute[75257]:   <serial>f01f386a-4a49-4a3f-932c-f3bdd88a29a4</serial>
Nov 14 02:10:55 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:10:55 user nova-compute[75257]: </disk>
Nov 14 02:10:55 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:10:55 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Successfully detached device vdb from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb from the persistent domain config.
Nov 14 02:10:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:10:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:10:55 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:10:55 user nova-compute[75257]:   <source dev="/dev/sdh"/>
Nov 14 02:10:55 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:10:55 user nova-compute[75257]:   <serial>f01f386a-4a49-4a3f-932c-f3bdd88a29a4</serial>
Nov 14 02:10:55 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:10:55 user nova-compute[75257]: </disk>
Nov 14 02:10:55 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:10:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:57 user nova-compute[75257]: INFO nova.compute.manager [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Terminating instance
Nov 14 02:10:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received event network-vif-unplugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] Acquiring lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] No waiting events found dispatching network-vif-unplugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-9555f65f-b15f-4e9b-b092-4e45065d6b88 req-311ae81c-c638-47ab-94ae-1c797bddd194 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received event network-vif-unplugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Instance destroyed successfully.
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.objects.instance [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lazy-loading 'resources' on Instance uuid 907693ff-78a5-4fd7-8f75-c70f6186cbbe {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:09:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-467865777',display_name='tempest-VolumesAdminNegativeTest-server-467865777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-467865777',id=13,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b4120a890b64ac9abb385f0ba8d3447',ramdisk_id='',reservation_id='r-69dh4nws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1630669709',owner_user_name='tempest-VolumesAdminNegativeTest-1630669709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:09:10Z,user_data=None,user_id='9e4dbe6bba744f4cabba17fcbea21c64',uuid=907693ff-78a5-4fd7-8f75-c70f6186cbbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converting VIF {"id": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "address": "fa:16:3e:08:d0:6e", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf51ac46-09", "ovs_interfaceid": "cf51ac46-0972-4e4e-9fea-bc81307c13f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=cf51ac46-0972-4e4e-9fea-bc81307c13f9,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf51ac46-09') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG os_vif [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=cf51ac46-0972-4e4e-9fea-bc81307c13f9,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf51ac46-09') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf51ac46-09, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cc0b36b-b53b-4b38-aecc-9cde115cd9e9) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:10:58 user nova-compute[75257]: INFO os_vif [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=cf51ac46-0972-4e4e-9fea-bc81307c13f9,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf51ac46-09')
Nov 14 02:10:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Deleting instance files /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe_del
Nov 14 02:10:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Deletion of /opt/stack/data/nova/instances/907693ff-78a5-4fd7-8f75-c70f6186cbbe_del complete
Nov 14 02:10:58 user nova-compute[75257]: INFO nova.compute.manager [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 02:10:58 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received event network-vif-deleted-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:10:58 user nova-compute[75257]: INFO nova.compute.manager [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Neutron deleted interface cf51ac46-0972-4e4e-9fea-bc81307c13f9; detaching it from the instance and deleting it from the info cache
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.network.neutron [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:10:58 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Took 0.55 seconds to deallocate network for instance.
Nov 14 02:10:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-4ffe7d58-820e-465d-8fbe-7d84b6791544 req-422fab69-c070-4013-9064-29f77b7725c1 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Detach interface failed, port_id=cf51ac46-0972-4e4e-9fea-bc81307c13f9, reason: Instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:59 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:10:59 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:10:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:59 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Deleted allocations for instance 907693ff-78a5-4fd7-8f75-c70f6186cbbe
Nov 14 02:10:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4435c936-3980-4278-96a0-50af9760ee81 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.946s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received event network-vif-plugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:10:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] Acquiring lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:10:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:10:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] Lock "907693ff-78a5-4fd7-8f75-c70f6186cbbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:10:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] No waiting events found dispatching network-vif-plugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:10:59 user nova-compute[75257]: WARNING nova.compute.manager [req-cfdba8e4-f078-4330-8dba-748fd5d0c496 req-0e2d0783-3eae-4c38-8310-15df54e28db0 service nova] [instance: 907693ff-78a5-4fd7-8f75-c70f6186cbbe] Received unexpected event network-vif-plugged-cf51ac46-0972-4e4e-9fea-bc81307c13f9 for instance with vm_state deleted and task_state None.
Nov 14 02:11:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-changed-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing instance network info cache due to event network-changed-dee8e8d1-721c-4209-8bd4-b0c873f68c66. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:11:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] Acquiring lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] Acquired lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:10 user nova-compute[75257]: DEBUG nova.network.neutron [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Refreshing network info cache for port dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:11:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:10 user nova-compute[75257]: DEBUG nova.network.neutron [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updated VIF entry in instance network info cache for port dee8e8d1-721c-4209-8bd4-b0c873f68c66. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:11:10 user nova-compute[75257]: DEBUG nova.network.neutron [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [{"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-cccfa84b-6f9b-4d10-9687-65128663b2bc req-1b360686-bce2-4124-88c2-47ad3597c97c service nova] Releasing lock "refresh_cache-efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:11:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:11:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updating instance_info_cache with network_info: [{"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:12 user nova-compute[75257]: INFO nova.compute.manager [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Terminating instance
Nov 14 02:11:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-unplugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-860e567d-b901-467a-9f23-98cca91b7c5d req-f8aa4a96-6fd0-48f5-9b61-362fc48f0daf service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-unplugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-7980e9f4-f5be-4237-8bca-3bf2c5ce7465 req-5ade9828-9d10-4172-b800-c6718cdef559 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:14 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Instance destroyed successfully.
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.objects.instance [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lazy-loading 'resources' on Instance uuid efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:2d:6a,bridge_name='br-int',has_traffic_filtering=True,id=dee8e8d1-721c-4209-8bd4-b0c873f68c66,network=Network(2e1fdf2a-bf16-456d-ab5a-3d43518b2c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8e8d1-72') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:2d:6a,bridge_name='br-int',has_traffic_filtering=True,id=dee8e8d1-721c-4209-8bd4-b0c873f68c66,network=Network(2e1fdf2a-bf16-456d-ab5a-3d43518b2c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8e8d1-72') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdee8e8d1-72, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3f169c4-6af9-4d3b-b83b-ebca7b4c0856) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: INFO os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:2d:6a,bridge_name='br-int',has_traffic_filtering=True,id=dee8e8d1-721c-4209-8bd4-b0c873f68c66,network=Network(2e1fdf2a-bf16-456d-ab5a-3d43518b2c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdee8e8d1-72')
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:dc:54,bridge_name='br-int',has_traffic_filtering=True,id=90c018ce-1c12-4cb8-9d98-070fd8a1810a,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap90c018ce-1c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:dc:54,bridge_name='br-int',has_traffic_filtering=True,id=90c018ce-1c12-4cb8-9d98-070fd8a1810a,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap90c018ce-1c') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90c018ce-1c, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0dea9f5-e555-45a6-a96f-1227d6eaee09) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: INFO os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:dc:54,bridge_name='br-int',has_traffic_filtering=True,id=90c018ce-1c12-4cb8-9d98-070fd8a1810a,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap90c018ce-1c')
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=4a898ff3-bac1-49d0-8d99-f3fc06539056,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a898ff3-ba') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=4a898ff3-bac1-49d0-8d99-f3fc06539056,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a898ff3-ba') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a898ff3-ba, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ba5c1ed-8901-4bf3-935a-e08af23a18ad) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: INFO os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:8d:80,bridge_name='br-int',has_traffic_filtering=True,id=4a898ff3-bac1-49d0-8d99-f3fc06539056,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a898ff3-ba')
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=bcd5d4d3-5459-408b-8924-5f08d38ccb8e,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd5d4d3-54') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=bcd5d4d3-5459-408b-8924-5f08d38ccb8e,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd5d4d3-54') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcd5d4d3-54, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85400758-56a8-4be0-8af6-a0f000e8d6ec) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:14 user nova-compute[75257]: INFO os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=bcd5d4d3-5459-408b-8924-5f08d38ccb8e,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd5d4d3-54')
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3b:b0,bridge_name='br-int',has_traffic_filtering=True,id=02264a33-a74b-4f31-b3f0-6c416fc4f7a1,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02264a33-a7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:14 user nova-compute[75257]: DEBUG os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3b:b0,bridge_name='br-int',has_traffic_filtering=True,id=02264a33-a74b-4f31-b3f0-6c416fc4f7a1,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02264a33-a7') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02264a33-a7, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5606fe91-d97e-425f-83ef-dd259114eedf) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: INFO os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3b:b0,bridge_name='br-int',has_traffic_filtering=True,id=02264a33-a74b-4f31-b3f0-6c416fc4f7a1,network=Network(164a6a04-0f10-46ef-9619-d131b1fcf204),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02264a33-a7')
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ac:f0,bridge_name='br-int',has_traffic_filtering=True,id=135ef6eb-a5e3-4537-b64f-404b6bca66f5,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ef6eb-a5') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ac:f0,bridge_name='br-int',has_traffic_filtering=True,id=135ef6eb-a5e3-4537-b64f-404b6bca66f5,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ef6eb-a5') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap135ef6eb-a5, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c269d268-394b-43b7-ac3e-6e4a1e373df4) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: INFO os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ac:f0,bridge_name='br-int',has_traffic_filtering=True,id=135ef6eb-a5e3-4537-b64f-404b6bca66f5,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ef6eb-a5')
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564274647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564274647',id=14,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8K3W1tFQVLeu7eQMArTAw14SHIrqlmflQ4zPPjaJsL+2ltVhO08ZMtN8iWqrndju1Vwdn7hhulkP21iPwuS5dmMP0rHqI2E/yvjH4VJMndvr0b4A+7fa85YCrTspZVpA==',key_name='tempest-keypair-1397456095',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8e8769c7e544a05a5a9ac80bda1639b',ramdisk_id='',reservation_id='r-iveens7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-322022406',owner_user_name='tempest-TaggedBootDevicesTest_v242-322022406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:09:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc679b09a1643b2963e33a2c5059cd8',uuid=efcc83ac-1f8b-43bd-84a1-36c6ab4fa889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converting VIF {"id": "8a2fed29-201a-4e15-a780-532c03191f10", "address": "fa:16:3e:9a:fe:41", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2fed29-20", "ovs_interfaceid": "8a2fed29-201a-4e15-a780-532c03191f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fe:41,bridge_name='br-int',has_traffic_filtering=True,id=8a2fed29-201a-4e15-a780-532c03191f10,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2fed29-20') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fe:41,bridge_name='br-int',has_traffic_filtering=True,id=8a2fed29-201a-4e15-a780-532c03191f10,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2fed29-20') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a2fed29-20, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e707358c-dcf4-4365-9ab7-735396c3c6a2) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:15 user nova-compute[75257]: INFO os_vif [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fe:41,bridge_name='br-int',has_traffic_filtering=True,id=8a2fed29-201a-4e15-a780-532c03191f10,network=Network(a956ca95-3ed3-4b19-ae00-dd5ab51f84ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2fed29-20')
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:15 user nova-compute[75257]: WARNING nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-dee8e8d1-721c-4209-8bd4-b0c873f68c66 for instance with vm_state active and task_state deleting.
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-unplugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:15 user nova-compute[75257]: WARNING nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-4a898ff3-bac1-49d0-8d99-f3fc06539056 for instance with vm_state active and task_state deleting.
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-unplugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:15 user nova-compute[75257]: WARNING nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-bcd5d4d3-5459-408b-8924-5f08d38ccb8e for instance with vm_state active and task_state deleting.
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-unplugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:15 user nova-compute[75257]: WARNING nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-135ef6eb-a5e3-4537-b64f-404b6bca66f5 for instance with vm_state active and task_state deleting.
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-unplugged-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-b7f61b5f-db3b-4c0a-9f9f-2eed2572ca61 req-0851d869-635a-48e3-820f-fc4fbb57aa85 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-8a2fed29-201a-4e15-a780-532c03191f10 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSmewBua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:15 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5287d40d-32c6-4361-b631-e2f982be0d2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:11:15 user nova-compute[75257]: No targets found.
Nov 14 02:11:15 user nova-compute[75257]: iSNS:
Nov 14 02:11:15 user nova-compute[75257]: No targets found.
Nov 14 02:11:15 user nova-compute[75257]: STATIC:
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: FIRMWARE:
Nov 14 02:11:15 user nova-compute[75257]: No targets found.
Nov 14 02:11:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:11:15 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:11:15 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48dcb56-f865-496b-9546-070472675c60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[27390e44-a387-44b6-a9d9-eb7edc5552cd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3c8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f60a35-0aa1-4e89-95cc-b5663d8558dc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e71a06e-0991-48f6-b39f-74815d9c1328]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:11:15 user nova-compute[75257]: INFO nova.compute.claims [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Claim successful on node user
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c582f3c3-1b23-41d0-85de-c3663eef9220]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff405e4-172b-40b6-b320-a1f875cdcb8d]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:15 user nova-compute[75257]: WARNING nova.compute.manager [req-83644387-7f1a-4958-a30e-3d3f5b120819 req-2f71d438-264a-4994-9bf1-74618f5f86f9 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-90c018ce-1c12-4cb8-9d98-070fd8a1810a for instance with vm_state active and task_state deleting.
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[18440885-88bf-425a-8cc1-195289bc5ce5]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc3b7d-8ad4-487d-afe5-52123b1f0b08]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852, portal: 172.16.0.220,3260]
Nov 14 02:11:15 user nova-compute[75257]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852, portal: 172.16.0.220,3260] successful.
Nov 14 02:11:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b143ff44-1d3e-4b3e-8ac6-3bb8d43b0852 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d686a2-c3bd-44b7-9589-993c32726d4c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] <== disconnect_volume: return (450ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Fjhlfxmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:15 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[48371669-e9fa-4d10-a85a-357599b5fb9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:11:15 user nova-compute[75257]: No targets found.
Nov 14 02:11:15 user nova-compute[75257]: iSNS:
Nov 14 02:11:15 user nova-compute[75257]: No targets found.
Nov 14 02:11:15 user nova-compute[75257]: STATIC:
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f
Nov 14 02:11:15 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:15 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:15 user nova-compute[75257]: FIRMWARE:
Nov 14 02:11:15 user nova-compute[75257]: No targets found.
Nov 14 02:11:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:11:15 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:11:15 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[28842ac5-b185-4e29-bc51-fb471b6eb8ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f441e71-2886-4e1d-b09b-fb7fba4ff10b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:11:15 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a58d7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93'): ({'sde'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Removing single pathed devices sde {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b977d5c-3078-4bfd-aefb-24724b0328e6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb is timed out.
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Successfully detached device vdb from instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb from the live domain config.
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rdAvipBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:15 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[24636c63-f448-438e-844a-54b2a5a4172d]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Flushing IO for device /dev/sde {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebe339e-296e-473e-961f-528bc5b01a7d]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9500b79-73f6-48d6-90a4-d12b8dc72eb4]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c5668d-7782-4c9d-8d3a-64d30897ca69]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe67eef-966e-4c21-a741-a05a4b20ecf4]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93, portal: 172.16.0.220,3260]
Nov 14 02:11:16 user nova-compute[75257]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93, portal: 172.16.0.220,3260] successful.
Nov 14 02:11:16 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41a69a2f-9c7d-4986-b1f8-6bd5e39ffe93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6666995-6d0e-4223-ba7c-60ebc525706f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] <== disconnect_volume: return (399ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.243s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roheIsYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:16 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7dc59c-e213-40c5-b6d6-fa15757a6f7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:11:16 user nova-compute[75257]: No targets found.
Nov 14 02:11:16 user nova-compute[75257]: iSNS:
Nov 14 02:11:16 user nova-compute[75257]: No targets found.
Nov 14 02:11:16 user nova-compute[75257]: STATIC:
Nov 14 02:11:16 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:11:16 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:16 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:16 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4
Nov 14 02:11:16 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:16 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:16 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:11:16 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:16 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:16 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f
Nov 14 02:11:16 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:16 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:16 user nova-compute[75257]: FIRMWARE:
Nov 14 02:11:16 user nova-compute[75257]: No targets found.
Nov 14 02:11:16 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:11:16 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:11:16 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.policy [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2cd8af-638c-424b-b692-7fc5c51c73b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba045a2-0796-460d-b654-a19362615e68]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:16 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:16 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3ea440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4'): ({'sdh'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Removing single pathed devices sdh {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60b6e65-d2c8-4b01-881a-22bc5a6c5c28]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:11:16 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Creating image(s)
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "/opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "/opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "/opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd26814-22ff-4165-adf3-ccf6e3612d3a]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Flushing IO for device /dev/sdh {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4596f8b-f18c-4429-bc93-b61eaab99213]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8106ec-78f6-4074-b921-38df2a32be91]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] SCSI volumes sdh have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad0f0c7-23e5-45c3-b9c0-0edcb7df7653]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.213s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e12118-5dfa-4a57-893f-f479ea432d64]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4, portal: 172.16.0.220,3260]
Nov 14 02:11:16 user nova-compute[75257]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4, portal: 172.16.0.220,3260] successful.
Nov 14 02:11:16 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01f386a-4a49-4a3f-932c-f3bdd88a29a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a114a6b-6a2b-4417-831d-cd13f657832d]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] <== disconnect_volume: return (707ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.469s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bd99cf-6b90-49f4-9ed3-9f7fdbf6042a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:11:16 user nova-compute[75257]: No targets found.
Nov 14 02:11:16 user nova-compute[75257]: iSNS:
Nov 14 02:11:16 user nova-compute[75257]: No targets found.
Nov 14 02:11:16 user nova-compute[75257]: STATIC:
Nov 14 02:11:16 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:11:16 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:16 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:16 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:11:16 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:16 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:16 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f
Nov 14 02:11:16 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:16 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:16 user nova-compute[75257]: FIRMWARE:
Nov 14 02:11:16 user nova-compute[75257]: No targets found.
Nov 14 02:11:16 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:11:16 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:11:16 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[647e8e77-800e-4ad3-bf7e-9d4206da2403]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[491046e3-8ead-4cad-a770-8bc21bfe7da7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:16 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:16 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:16 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3b3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f'): ({'sdf'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Removing single pathed devices sdf {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Successfully created port: c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c078b67-db4f-419e-b77f-52de69bea50d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk 1073741824" returned: 0 in 0.062s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d55d231-511d-4987-9d96-fe1eb00c9908]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Flushing IO for device /dev/sdf {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d56c859-88dc-4ecb-b726-ce15c41c3cf6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[db101d8f-2062-430b-adc4-81a5f9e4086a]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a4fa7a-c1fb-4634-8d57-cab97342852c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[315c200f-7896-4183-922d-6e5a378b7a0d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f, portal: 172.16.0.220,3260]
Nov 14 02:11:16 user nova-compute[75257]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f, portal: 172.16.0.220,3260] successful.
Nov 14 02:11:16 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a21b79-bdd1-4efb-b413-c3e783a6770f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc35ad-b757-4d8e-ac2a-8677d6fac884]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] <== disconnect_volume: return (929ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:11:17 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Deleting instance files /opt/stack/data/nova/instances/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889_del
Nov 14 02:11:17 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Deletion of /opt/stack/data/nova/instances/efcc83ac-1f8b-43bd-84a1-36c6ab4fa889_del complete
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'flavor' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Successfully updated port: c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:17 user nova-compute[75257]: WARNING nova.compute.manager [req-f0891d06-f124-47f2-8806-19e3a5104562 req-82075204-6f64-4e47-b6a4-bf4b72447623 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-8a2fed29-201a-4e15-a780-532c03191f10 for instance with vm_state active and task_state deleting.
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.577s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Cannot resize image /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Ensure instance console log exists: /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquired lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:11:17 user nova-compute[75257]: INFO nova.compute.manager [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Took 4.90 seconds to destroy the instance on the hypervisor.
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:11:17 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:11:17 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7485MB free_disk=25.383949279785156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0afc6ab6-57bf-4742-8081-2cd4c0afc9cb tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.448s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received event network-changed-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Refreshing instance network info cache due to event network-changed-c975f85e-f764-4db8-a9e1-e07ca13ce937. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] Acquiring lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 71a9d20f-e79b-4716-abf8-a15330742167 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2f9df98c-7814-419d-8821-d8c571972f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance fd62b270-19d7-45e5-bd66-a94c384050bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance d89aad70-7a33-4519-8308-f9ed98031692 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updating instance_info_cache with network_info: [{"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Releasing lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Instance network_info: |[{"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] Acquired lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Refreshing network info cache for port c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Start _get_guest_xml network_info=[{"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:11:17 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:11:17 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:11:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1676388090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1676388090',id=17,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-ry4yecf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:11:16Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=42cdcf9f-848c-4960-87ca-3a8afa145b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=c975f85e-f764-4db8-a9e1-e07ca13ce937,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc975f85e-f7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'pci_devices' on Instance uuid 42cdcf9f-848c-4960-87ca-3a8afa145b6a {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:11:18 user nova-compute[75257]:   <uuid>42cdcf9f-848c-4960-87ca-3a8afa145b6a</uuid>
Nov 14 02:11:18 user nova-compute[75257]:   <name>instance-00000011</name>
Nov 14 02:11:18 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:11:18 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:11:18 user nova-compute[75257]:   <metadata>
Nov 14 02:11:18 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:11:18 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:11:18 user nova-compute[75257]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1676388090</nova:name>
Nov 14 02:11:18 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:11:17</nova:creationTime>
Nov 14 02:11:18 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:11:18 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:11:18 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:11:18 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:11:18 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:11:18 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:11:18 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:11:18 user nova-compute[75257]:       <nova:owner>
Nov 14 02:11:18 user nova-compute[75257]:         <nova:user uuid="addcfdac50de4b03bd3ad3142508edea">tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member</nova:user>
Nov 14 02:11:18 user nova-compute[75257]:         <nova:project uuid="ac29176de8fc434285721bbb6759966d">tempest-ServerBootFromVolumeStableRescueTest-1355021813</nova:project>
Nov 14 02:11:18 user nova-compute[75257]:       </nova:owner>
Nov 14 02:11:18 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:11:18 user nova-compute[75257]:       <nova:ports>
Nov 14 02:11:18 user nova-compute[75257]:         <nova:port uuid="c975f85e-f764-4db8-a9e1-e07ca13ce937">
Nov 14 02:11:18 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 02:11:18 user nova-compute[75257]:         </nova:port>
Nov 14 02:11:18 user nova-compute[75257]:       </nova:ports>
Nov 14 02:11:18 user nova-compute[75257]:     </nova:instance>
Nov 14 02:11:18 user nova-compute[75257]:   </metadata>
Nov 14 02:11:18 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:11:18 user nova-compute[75257]:     <system>
Nov 14 02:11:18 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:11:18 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:11:18 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:11:18 user nova-compute[75257]:       <entry name="serial">42cdcf9f-848c-4960-87ca-3a8afa145b6a</entry>
Nov 14 02:11:18 user nova-compute[75257]:       <entry name="uuid">42cdcf9f-848c-4960-87ca-3a8afa145b6a</entry>
Nov 14 02:11:18 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:11:18 user nova-compute[75257]:     </system>
Nov 14 02:11:18 user nova-compute[75257]:   </sysinfo>
Nov 14 02:11:18 user nova-compute[75257]:   <os>
Nov 14 02:11:18 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:11:18 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:11:18 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:11:18 user nova-compute[75257]:   </os>
Nov 14 02:11:18 user nova-compute[75257]:   <features>
Nov 14 02:11:18 user nova-compute[75257]:     <acpi/>
Nov 14 02:11:18 user nova-compute[75257]:     <apic/>
Nov 14 02:11:18 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:11:18 user nova-compute[75257]:   </features>
Nov 14 02:11:18 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:11:18 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:11:18 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:11:18 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:11:18 user nova-compute[75257]:   </clock>
Nov 14 02:11:18 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:11:18 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:11:18 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:11:18 user nova-compute[75257]:   </cpu>
Nov 14 02:11:18 user nova-compute[75257]:   <devices>
Nov 14 02:11:18 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:11:18 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:11:18 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk"/>
Nov 14 02:11:18 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:11:18 user nova-compute[75257]:     </disk>
Nov 14 02:11:18 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:11:18 user nova-compute[75257]:       <mac address="fa:16:3e:bc:5a:32"/>
Nov 14 02:11:18 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:11:18 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:11:18 user nova-compute[75257]:       <target dev="tapc975f85e-f7"/>
Nov 14 02:11:18 user nova-compute[75257]:     </interface>
Nov 14 02:11:18 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:11:18 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/console.log" append="off"/>
Nov 14 02:11:18 user nova-compute[75257]:     </serial>
Nov 14 02:11:18 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:11:18 user nova-compute[75257]:     <video>
Nov 14 02:11:18 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:11:18 user nova-compute[75257]:     </video>
Nov 14 02:11:18 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:11:18 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:11:18 user nova-compute[75257]:     </rng>
Nov 14 02:11:18 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:11:18 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:11:18 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:11:18 user nova-compute[75257]:     </memballoon>
Nov 14 02:11:18 user nova-compute[75257]:   </devices>
Nov 14 02:11:18 user nova-compute[75257]: </domain>
Nov 14 02:11:18 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1676388090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1676388090',id=17,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-ry4yecf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:11:16Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=42cdcf9f-848c-4960-87ca-3a8afa145b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=c975f85e-f764-4db8-a9e1-e07ca13ce937,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc975f85e-f7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG os_vif [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=c975f85e-f764-4db8-a9e1-e07ca13ce937,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc975f85e-f7') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe209797-87ae-5545-ad8d-d45c3fa7cedb', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc975f85e-f7, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc975f85e-f7, col_values=(('qos', UUID('a8f0bbe0-e0a5-4025-a0ab-edb4d6e9bc34')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc975f85e-f7, col_values=(('external_ids', {'iface-id': 'c975f85e-f764-4db8-a9e1-e07ca13ce937', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:5a:32', 'vm-uuid': '42cdcf9f-848c-4960-87ca-3a8afa145b6a'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:18 user nova-compute[75257]: INFO os_vif [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=c975f85e-f764-4db8-a9e1-e07ca13ce937,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc975f85e-f7')
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No VIF found with MAC fa:16:3e:bc:5a:32, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.network.neutron [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updated VIF entry in instance network info cache for port c975f85e-f764-4db8-a9e1-e07ca13ce937. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.network.neutron [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updating instance_info_cache with network_info: [{"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dcd1ca75-e072-485e-8dc3-4e0202dd29ab req-125e2c3d-b537-4375-9720-eeb1c43e26b3 service nova] Releasing lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-unplugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-441d48bd-9a22-46bf-9b97-5e469b4366bd req-19edd2ed-0479-429c-8420-7158df18baaa service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-unplugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:11:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-deleted-8a2fed29-201a-4e15-a780-532c03191f10 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:19 user nova-compute[75257]: INFO nova.compute.manager [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Neutron deleted interface 8a2fed29-201a-4e15-a780-532c03191f10; detaching it from the instance and deleting it from the info cache
Nov 14 02:11:19 user nova-compute[75257]: DEBUG nova.network.neutron [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [{"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "address": "fa:16:3e:dd:ac:f0", "network": {"id": "a956ca95-3ed3-4b19-ae00-dd5ab51f84ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1396512160", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ef6eb-a5", "ovs_interfaceid": "135ef6eb-a5e3-4537-b64f-404b6bca66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b30b145-dfef-4501-b4be-fa209a0c9c33 req-057e8391-d458-46e6-b0b6-8625ed72eec7 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Detach interface failed, port_id=8a2fed29-201a-4e15-a780-532c03191f10, reason: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:11:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-plugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] Acquiring lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] No waiting events found dispatching network-vif-plugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:20 user nova-compute[75257]: WARNING nova.compute.manager [req-888c7f6e-9e06-4180-9e51-29b155537d0a req-50a07f02-e4a0-4f0f-be1a-f202602cad1c service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received unexpected event network-vif-plugged-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 for instance with vm_state active and task_state deleting.
Nov 14 02:11:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:21 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:11:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:11:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received event network-vif-plugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Acquiring lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] No waiting events found dispatching network-vif-plugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:22 user nova-compute[75257]: WARNING nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received unexpected event network-vif-plugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance with vm_state building and task_state spawning.
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received event network-vif-plugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Acquiring lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] No waiting events found dispatching network-vif-plugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:22 user nova-compute[75257]: WARNING nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received unexpected event network-vif-plugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance with vm_state building and task_state spawning.
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-deleted-135ef6eb-a5e3-4537-b64f-404b6bca66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:22 user nova-compute[75257]: INFO nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Neutron deleted interface 135ef6eb-a5e3-4537-b64f-404b6bca66f5; detaching it from the instance and deleting it from the info cache
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [{"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "address": "fa:16:3e:aa:3b:b0", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02264a33-a7", "ovs_interfaceid": "02264a33-a74b-4f31-b3f0-6c416fc4f7a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:22 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Instance spawned successfully.
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Detach interface failed, port_id=135ef6eb-a5e3-4537-b64f-404b6bca66f5, reason: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-deleted-02264a33-a74b-4f31-b3f0-6c416fc4f7a1 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:22 user nova-compute[75257]: INFO nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Neutron deleted interface 02264a33-a74b-4f31-b3f0-6c416fc4f7a1; detaching it from the instance and deleting it from the info cache
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [{"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "address": "fa:16:3e:2d:0c:04", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd5d4d3-54", "ovs_interfaceid": "bcd5d4d3-5459-408b-8924-5f08d38ccb8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Detach interface failed, port_id=02264a33-a74b-4f31-b3f0-6c416fc4f7a1, reason: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-deleted-bcd5d4d3-5459-408b-8924-5f08d38ccb8e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:22 user nova-compute[75257]: INFO nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Neutron deleted interface bcd5d4d3-5459-408b-8924-5f08d38ccb8e; detaching it from the instance and deleting it from the info cache
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [{"id": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "address": "fa:16:3e:1a:2d:6a", "network": {"id": "2e1fdf2a-bf16-456d-ab5a-3d43518b2c78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-15360616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdee8e8d1-72", "ovs_interfaceid": "dee8e8d1-721c-4209-8bd4-b0c873f68c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "address": "fa:16:3e:8b:dc:54", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c018ce-1c", "ovs_interfaceid": "90c018ce-1c12-4cb8-9d98-070fd8a1810a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "address": "fa:16:3e:c8:8d:80", "network": {"id": "164a6a04-0f10-46ef-9619-d131b1fcf204", "bridge": "br-int", "label": "tempest-device-tagging-net1-2008792290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a8e8769c7e544a05a5a9ac80bda1639b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a898ff3-ba", "ovs_interfaceid": "4a898ff3-bac1-49d0-8d99-f3fc06539056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-21640a06-e06c-4067-8688-63c4b6eb985d req-d6cfd369-2206-4d66-bb0e-014f44c10363 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Detach interface failed, port_id=bcd5d4d3-5459-408b-8924-5f08d38ccb8e, reason: Instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:11:22 user nova-compute[75257]: INFO nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:11:22 user nova-compute[75257]: INFO nova.compute.manager [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Took 6.88 seconds to build instance.
Nov 14 02:11:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2e1c059d-4afb-4dd0-9f08-b02ab787bec4 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.984s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:22 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:22 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Took 4.81 seconds to deallocate network for instance.
Nov 14 02:11:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-b2ae4729-4ae7-4d31-beb6-9d5c7d3021c7 req-27bb7253-043e-4ea7-aeb0-7248580f5772 service nova] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Received event network-vif-deleted-dee8e8d1-721c-4209-8bd4-b0c873f68c66 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:24 user nova-compute[75257]: INFO nova.compute.manager [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] [instance: efcc83ac-1f8b-43bd-84a1-36c6ab4fa889] Took 2.50 seconds to detach 3 volumes for instance.
Nov 14 02:11:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:25 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:11:25 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:11:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:25 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Deleted allocations for instance efcc83ac-1f8b-43bd-84a1-36c6ab4fa889
Nov 14 02:11:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-93a90a5d-d1e0-49e2-9e2d-d629c6271fd3 tempest-TaggedBootDevicesTest_v242-322022406 tempest-TaggedBootDevicesTest_v242-322022406-project-member] Lock "efcc83ac-1f8b-43bd-84a1-36c6ab4fa889" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.798s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:11:35 user nova-compute[75257]: INFO nova.compute.claims [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Claim successful on node user
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:11:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.policy [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:11:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Creating image(s)
Nov 14 02:11:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "/opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "/opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "/opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "6255c22f7207f2c5105de06f2e1fb3bc9ba956c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "6255c22f7207f2c5105de06f2e1fb3bc9ba956c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Successfully created port: de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-changed-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Refreshing instance network info cache due to event network-changed-6e7908eb-09c1-4662-b587-2a28838e6ca6. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] Acquiring lock "refresh_cache-b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] Acquired lock "refresh_cache-b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Refreshing network info cache for port 6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.virt.images [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7 was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8.part /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8.part /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8.converted" returned: 0 in 0.218s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'flavor' on Instance uuid b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "6255c22f7207f2c5105de06f2e1fb3bc9ba956c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.121s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Updated VIF entry in instance network info cache for port 6e7908eb-09c1-4662-b587-2a28838e6ca6. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Updating instance_info_cache with network_info: [{"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-46ad5d98-dbb1-4e6a-b618-39d5fb7389dc req-36c4b612-c48b-4878-b342-77a6d52d3950 service nova] Releasing lock "refresh_cache-b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Successfully updated port: de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquired lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-changed-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing instance network info cache due to event network-changed-de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:11:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] Acquiring lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8 --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "6255c22f7207f2c5105de06f2e1fb3bc9ba956c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "6255c22f7207f2c5105de06f2e1fb3bc9ba956c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:37 user nova-compute[75257]: INFO nova.compute.manager [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Attaching volume 57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 to /dev/vdb
Nov 14 02:11:37 user nova-compute[75257]: DEBUG os_brick.utils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c730eee-56c5-4d28-85cf-7f1d10c32789]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ba535e-7ec9-4de3-84c8-cba1998705ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[da742045-ab51-41e3-a574-a7a68ed898e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dca9884-9ea9-42c0-80bc-99dc40a53839]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8 --force-share --output=json" returned: 0 in 0.250s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8,backing_fmt=raw /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:11:37 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff573f11-89fc-4045-b6eb-0372fa801f3d]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG os_brick.utils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Updating existing volume attachment record: 9572c5ae-6613-41ab-acfc-e622bfd22abf {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8,backing_fmt=raw /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk 1073741824" returned: 0 in 0.053s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "6255c22f7207f2c5105de06f2e1fb3bc9ba956c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updating instance_info_cache with network_info: [{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Releasing lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Instance network_info: |[{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] Acquired lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.network.neutron [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing network info cache for port de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8 --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Cannot resize image /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Ensure instance console log exists: /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Start _get_guest_xml network_info=[{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:11:32Z,direct_url=<?>,disk_format='qcow2',id=3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7,min_disk=0,min_ram=0,name='tempest-scenario-img--2099320441',owner='9cfe231fae1941f4970c17e344df8b81',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:11:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:11:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:11:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:11:32Z,direct_url=<?>,disk_format='qcow2',id=3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7,min_disk=0,min_ram=0,name='tempest-scenario-img--2099320441',owner='9cfe231fae1941f4970c17e344df8b81',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:11:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550486898',display_name='tempest-TestMinimumBasicScenario-server-550486898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550486898',id=18,image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCerez3qRud3tNAAT12b+t4i+0H7Sr5njhlCmhyMPjU2JaLT1djZUoYL1W2kD0Bsh7apkcxxkNW/Nd2lfcp9UJBVsonfsZCS9Q4VFC2iCaV+Xa1MxoJDOhjo3xsuwm5kw==',key_name='tempest-TestMinimumBasicScenario-1349261540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cfe231fae1941f4970c17e344df8b81',ramdisk_id='',reservation_id='r-p0leackj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1293674307',owner_user_name='tempest-TestMinimumBasicScenario-1293674307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:11:36Z,user_data=None,user_id='87f69eeadbaf45bfa01dfdfa5efcccb3',uuid=2751bcd6-e958-4216-89f9-5e23f8b9dd9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converting VIF {"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'pci_devices' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:11:37 user nova-compute[75257]:   <uuid>2751bcd6-e958-4216-89f9-5e23f8b9dd9b</uuid>
Nov 14 02:11:37 user nova-compute[75257]:   <name>instance-00000012</name>
Nov 14 02:11:37 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:11:37 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:11:37 user nova-compute[75257]:   <metadata>
Nov 14 02:11:37 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:11:37 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:11:37 user nova-compute[75257]:       <nova:name>tempest-TestMinimumBasicScenario-server-550486898</nova:name>
Nov 14 02:11:37 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:11:37</nova:creationTime>
Nov 14 02:11:37 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:11:37 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:11:37 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:11:37 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:11:37 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:11:37 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:11:37 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:11:37 user nova-compute[75257]:       <nova:owner>
Nov 14 02:11:37 user nova-compute[75257]:         <nova:user uuid="87f69eeadbaf45bfa01dfdfa5efcccb3">tempest-TestMinimumBasicScenario-1293674307-project-member</nova:user>
Nov 14 02:11:37 user nova-compute[75257]:         <nova:project uuid="9cfe231fae1941f4970c17e344df8b81">tempest-TestMinimumBasicScenario-1293674307</nova:project>
Nov 14 02:11:37 user nova-compute[75257]:       </nova:owner>
Nov 14 02:11:37 user nova-compute[75257]:       <nova:root type="image" uuid="3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7"/>
Nov 14 02:11:37 user nova-compute[75257]:       <nova:ports>
Nov 14 02:11:37 user nova-compute[75257]:         <nova:port uuid="de607b68-f250-49c9-ac97-489a341f5963">
Nov 14 02:11:37 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 02:11:37 user nova-compute[75257]:         </nova:port>
Nov 14 02:11:37 user nova-compute[75257]:       </nova:ports>
Nov 14 02:11:37 user nova-compute[75257]:     </nova:instance>
Nov 14 02:11:37 user nova-compute[75257]:   </metadata>
Nov 14 02:11:37 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:11:37 user nova-compute[75257]:     <system>
Nov 14 02:11:37 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:11:37 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:11:37 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:11:37 user nova-compute[75257]:       <entry name="serial">2751bcd6-e958-4216-89f9-5e23f8b9dd9b</entry>
Nov 14 02:11:37 user nova-compute[75257]:       <entry name="uuid">2751bcd6-e958-4216-89f9-5e23f8b9dd9b</entry>
Nov 14 02:11:37 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:11:37 user nova-compute[75257]:     </system>
Nov 14 02:11:37 user nova-compute[75257]:   </sysinfo>
Nov 14 02:11:37 user nova-compute[75257]:   <os>
Nov 14 02:11:37 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:11:37 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:11:37 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:11:37 user nova-compute[75257]:   </os>
Nov 14 02:11:37 user nova-compute[75257]:   <features>
Nov 14 02:11:37 user nova-compute[75257]:     <acpi/>
Nov 14 02:11:37 user nova-compute[75257]:     <apic/>
Nov 14 02:11:37 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:11:37 user nova-compute[75257]:   </features>
Nov 14 02:11:37 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:11:37 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:11:37 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:11:37 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:11:37 user nova-compute[75257]:   </clock>
Nov 14 02:11:37 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:11:37 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:11:37 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:11:37 user nova-compute[75257]:   </cpu>
Nov 14 02:11:37 user nova-compute[75257]:   <devices>
Nov 14 02:11:37 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:11:37 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:11:37 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk"/>
Nov 14 02:11:37 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:11:37 user nova-compute[75257]:     </disk>
Nov 14 02:11:37 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:11:37 user nova-compute[75257]:       <mac address="fa:16:3e:d9:88:d1"/>
Nov 14 02:11:37 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:11:37 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:11:37 user nova-compute[75257]:       <target dev="tapde607b68-f2"/>
Nov 14 02:11:37 user nova-compute[75257]:     </interface>
Nov 14 02:11:37 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:11:37 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/console.log" append="off"/>
Nov 14 02:11:37 user nova-compute[75257]:     </serial>
Nov 14 02:11:37 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:11:37 user nova-compute[75257]:     <video>
Nov 14 02:11:37 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:11:37 user nova-compute[75257]:     </video>
Nov 14 02:11:37 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:11:37 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:11:37 user nova-compute[75257]:     </rng>
Nov 14 02:11:37 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:11:37 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:11:37 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:11:37 user nova-compute[75257]:     </memballoon>
Nov 14 02:11:37 user nova-compute[75257]:   </devices>
Nov 14 02:11:37 user nova-compute[75257]: </domain>
Nov 14 02:11:37 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550486898',display_name='tempest-TestMinimumBasicScenario-server-550486898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550486898',id=18,image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCerez3qRud3tNAAT12b+t4i+0H7Sr5njhlCmhyMPjU2JaLT1djZUoYL1W2kD0Bsh7apkcxxkNW/Nd2lfcp9UJBVsonfsZCS9Q4VFC2iCaV+Xa1MxoJDOhjo3xsuwm5kw==',key_name='tempest-TestMinimumBasicScenario-1349261540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cfe231fae1941f4970c17e344df8b81',ramdisk_id='',reservation_id='r-p0leackj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1293674307',owner_user_name='tempest-TestMinimumBasicScenario-1293674307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:11:36Z,user_data=None,user_id='87f69eeadbaf45bfa01dfdfa5efcccb3',uuid=2751bcd6-e958-4216-89f9-5e23f8b9dd9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converting VIF {"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG os_vif [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f871b633-4f08-5f0f-8d42-297b7c33a7cc', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde607b68-f2, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde607b68-f2, col_values=(('qos', UUID('084bab18-f5de-4ef1-8aa5-ba9f01b753bf')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde607b68-f2, col_values=(('external_ids', {'iface-id': 'de607b68-f250-49c9-ac97-489a341f5963', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:88:d1', 'vm-uuid': '2751bcd6-e958-4216-89f9-5e23f8b9dd9b'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:37 user nova-compute[75257]: INFO os_vif [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2')
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.network.neutron [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updated VIF entry in instance network info cache for port de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.network.neutron [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updating instance_info_cache with network_info: [{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-230eb745-d84a-4e1c-8732-46779e9f793e req-6e3953b6-51c3-49eb-bd31-c05ab59bac1e service nova] Releasing lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:11:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No VIF found with MAC fa:16:3e:d9:88:d1, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] No waiting events found dispatching network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:39 user nova-compute[75257]: WARNING nova.compute.manager [req-211a8715-1102-45ad-a869-20ed93e1dfc1 req-7c03c316-87f0-4535-996c-4948275a9a12 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received unexpected event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 for instance with vm_state building and task_state spawning.
Nov 14 02:11:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:40 user nova-compute[75257]: INFO nova.compute.manager [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Detaching volume 399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:11:40 user nova-compute[75257]: INFO nova.virt.block_device [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Attempting to driver detach volume 399fd6d1-cc6f-432c-96c2-eb97da1c0ceb from mountpoint /dev/vdb
Nov 14 02:11:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Attempting to detach device vdb from instance 71a9d20f-e79b-4716-abf8-a15330742167 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:11:40 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:11:40 user nova-compute[75257]:   <source dev="/dev/sdd"/>
Nov 14 02:11:40 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:11:40 user nova-compute[75257]:   <serial>399fd6d1-cc6f-432c-96c2-eb97da1c0ceb</serial>
Nov 14 02:11:40 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 02:11:40 user nova-compute[75257]: </disk>
Nov 14 02:11:40 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:11:40 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully detached device vdb from instance 71a9d20f-e79b-4716-abf8-a15330742167 from the persistent domain config.
Nov 14 02:11:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71a9d20f-e79b-4716-abf8-a15330742167 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:11:40 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:11:40 user nova-compute[75257]:   <source dev="/dev/sdd"/>
Nov 14 02:11:40 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:11:40 user nova-compute[75257]:   <serial>399fd6d1-cc6f-432c-96c2-eb97da1c0ceb</serial>
Nov 14 02:11:40 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 02:11:40 user nova-compute[75257]: </disk>
Nov 14 02:11:40 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:11:40 user nova-compute[75257]: INFO nova.compute.manager [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Unrescuing
Nov 14 02:11:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquired lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Releasing lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'flavor' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-unplugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-unplugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:41 user nova-compute[75257]: WARNING nova.compute.manager [req-29222682-ac04-4002-8ff8-c8fdc5eceffc req-79c864d7-f70d-4b00-806f-a8b0a41d6f57 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-unplugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] No waiting events found dispatching network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:41 user nova-compute[75257]: WARNING nova.compute.manager [req-a9aa6c8e-b500-4037-8e2e-9641d32a5e4c req-6a7bae0f-729d-4d65-ac31-9affacc1e149 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received unexpected event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 for instance with vm_state building and task_state spawning.
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:11:41 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Instance spawned successfully.
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-changed-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Refreshing instance network info cache due to event network-changed-8fe0bc37-945a-433d-8dd0-43514dce6f99. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] Acquiring lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] Acquired lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.network.neutron [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Refreshing network info cache for port 8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:41 user nova-compute[75257]: INFO nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:11:41 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Instance destroyed successfully.
Nov 14 02:11:41 user nova-compute[75257]: INFO nova.compute.manager [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Took 6.89 seconds to build instance.
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b33206d7-230e-4dea-99e9-9e3c0de731ac tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.065s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CczKsNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:41 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:11:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:41 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:11:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:41 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7ea3ab-2163-4153-a8c5-0165901ea081]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:11:41 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7e90c6-370e-49fd-b18d-6854108bf363]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1] added
Nov 14 02:11:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bc5c42-4ca1-43a0-ba82-86ff3bfe75dc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf540bf7-34f1-4d86-835d-9a4fc6835482]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CczKsNEl {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CczKsNEl" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45ca4e5-4acb-4b70-9f63-4a4598b3d552]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CczKsNEl'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f941308-f1bc-4baf-afeb-22dc1d1fd36e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd461f5e-717a-414f-812a-d21b199751b1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:42 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:42 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:42 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:42 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3de7094-64ab-4cb8-8c7d-1563e8ce8e1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260]
Nov 14 02:11:42 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260] successful.
Nov 14 02:11:42 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[901cf217-51bb-4f97-9d52-d1fdeea26007]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d420ac9a-23c3-47ca-a251-2e42870ae357]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:42 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:42 user nova-compute[75257]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:11:42 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:42 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:42 user nova-compute[75257]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:11:42 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG nova.network.neutron [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updated VIF entry in instance network info cache for port 8fe0bc37-945a-433d-8dd0-43514dce6f99. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG nova.network.neutron [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[596e9ca6-0659-43bb-bbae-3d3358efb24a]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CczKsNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4f00e383-a8ea-467c-b48d-e72f58e0aa3a req-9cb3d507-6dc2-4b63-b9e9-7224f243678e service nova] Releasing lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:43 user nova-compute[75257]: WARNING nova.compute.manager [req-efc18c05-45da-43cf-8b09-3bcf94420f38 req-271190da-a410-4ad6-a6b3-6ae4f68773a9 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:11:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23636333937623938', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636333937623938', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'flavor' on Instance uuid b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:11:43 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:11:43 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:11:43 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:11:43 user nova-compute[75257]:   <serial>57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1</serial>
Nov 14 02:11:43 user nova-compute[75257]: </disk>
Nov 14 02:11:43 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-changed-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Refreshing instance network info cache due to event network-changed-8fe0bc37-945a-433d-8dd0-43514dce6f99. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] Acquiring lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] Acquired lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Refreshing network info cache for port 8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No VIF found with MAC fa:16:3e:a5:e0:91, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d8025eda-45da-497c-bdcb-a9094e294686 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.061s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG nova.network.neutron [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updated VIF entry in instance network info cache for port 8fe0bc37-945a-433d-8dd0-43514dce6f99. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG nova.network.neutron [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [{"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-44034b84-dddf-49ec-85b6-0d433a917ade req-3f1b68ad-fb4b-4acf-8fc4-a96c0648041f service nova] Releasing lock "refresh_cache-b9b5a6d0-1304-49c1-90fb-5964d56885c8" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:45 user nova-compute[75257]: WARNING nova.compute.manager [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:11:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:45 user nova-compute[75257]: WARNING nova.compute.manager [req-555824f7-0f58-46a4-adc3-f7a6551089ee req-32213535-1760-45bd-92fa-4ed6bdc435b6 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:11:45 user nova-compute[75257]: INFO nova.compute.manager [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Rebuilding instance
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:45 user nova-compute[75257]: INFO nova.compute.manager [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Terminating instance
Nov 14 02:11:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received event network-vif-unplugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] No waiting events found dispatching network-vif-unplugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-20d4210d-04d2-4ca2-8956-889b82a4c7c4 req-d390ea80-7078-48c0-886f-16c90b042ab2 service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received event network-vif-unplugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e3f6f6c7-8b22-4005-84b7-18d56caf4c5c tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Instance destroyed successfully.
Nov 14 02:11:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Instance destroyed successfully.
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lazy-loading 'resources' on Instance uuid 1a6df88a-5599-4b10-917c-c3c0b009c3cb {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2071366743',display_name='tempest-TestServerVolumeAttachmentScenario-server-2071366743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2071366743',id=12,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLTqWumKP5WLuDxvDcPlc4017G4UnwfFpm58ymfDNqIIv4mmT7uWp6VUwoXAw4ASrN05TZ0JaBF1S4zNfqxHQpdOoaI/VdjQ0yhIPt3PxWX2JXh2URVHKy0oiWfxltLOA==',key_name='tempest-keypair-309882152',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5778b17ddccd4d7d82adbc420ad6adc0',ramdisk_id='',reservation_id='r-b1bkxfty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-76705494',owner_user_name='tempest-TestServerVolumeAttachmentScenario-76705494-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83c1fd3efa9a4997be00910265484154',uuid=1a6df88a-5599-4b10-917c-c3c0b009c3cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Converting VIF {"id": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "address": "fa:16:3e:55:56:65", "network": {"id": "ccc94fe2-6b16-46cd-8221-521a9b2cf069", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1676839931-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5778b17ddccd4d7d82adbc420ad6adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7946fb64-27", "ovs_interfaceid": "7946fb64-2722-4b7d-a7bc-5223ad6536e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:56:65,bridge_name='br-int',has_traffic_filtering=True,id=7946fb64-2722-4b7d-a7bc-5223ad6536e5,network=Network(ccc94fe2-6b16-46cd-8221-521a9b2cf069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7946fb64-27') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG os_vif [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:56:65,bridge_name='br-int',has_traffic_filtering=True,id=7946fb64-2722-4b7d-a7bc-5223ad6536e5,network=Network(ccc94fe2-6b16-46cd-8221-521a9b2cf069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7946fb64-27') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7946fb64-27, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2931d302-7db0-4f4a-83fc-8abc7682513a) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:46 user nova-compute[75257]: INFO os_vif [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:56:65,bridge_name='br-int',has_traffic_filtering=True,id=7946fb64-2722-4b7d-a7bc-5223ad6536e5,network=Network(ccc94fe2-6b16-46cd-8221-521a9b2cf069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7946fb64-27')
Nov 14 02:11:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Deleting instance files /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb_del
Nov 14 02:11:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Deletion of /opt/stack/data/nova/instances/1a6df88a-5599-4b10-917c-c3c0b009c3cb_del complete
Nov 14 02:11:46 user nova-compute[75257]: INFO nova.compute.manager [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Detaching volume 57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:11:46 user nova-compute[75257]: INFO nova.compute.manager [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:11:46 user nova-compute[75257]: INFO nova.virt.block_device [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Attempting to driver detach volume 57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 from mountpoint /dev/vdb
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Attempting to detach device vdb from instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:11:46 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:11:46 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:11:46 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:11:46 user nova-compute[75257]:   <serial>57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1</serial>
Nov 14 02:11:46 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:11:46 user nova-compute[75257]: </disk>
Nov 14 02:11:46 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:11:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully detached device vdb from instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 from the persistent domain config.
Nov 14 02:11:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CczKsNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:46 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 02:11:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa51835-3daf-4310-8624-f2b637545394]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:11:46 user nova-compute[75257]: No targets found.
Nov 14 02:11:46 user nova-compute[75257]: iSNS:
Nov 14 02:11:46 user nova-compute[75257]: No targets found.
Nov 14 02:11:46 user nova-compute[75257]: STATIC:
Nov 14 02:11:46 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:11:46 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:46 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:46 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:11:46 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:46 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:46 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:11:46 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:46 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:46 user nova-compute[75257]: FIRMWARE:
Nov 14 02:11:46 user nova-compute[75257]: No targets found.
Nov 14 02:11:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:11:46 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:11:46 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d67b541-d14d-410f-b500-3b57ef6e67f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84a15fb-a26c-40f5-919a-0e25e9e88648]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:46 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:46 user nova-compute[75257]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:11:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:46 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:46 user nova-compute[75257]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:11:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c209e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dc13aa-2b04-4151-8fb4-7fbda5c6893c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e403ec32-b142-4665-b346-a7d2b9f8c0ec]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b16bace-a9c9-488d-a45a-27d833271690]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e0126c-7504-45b2-bf48-82a4df95451b]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9be5041-802e-408e-a810-dfd05193c329]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e392e9e3-7806-4cae-888a-5204d30fd12d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260]
Nov 14 02:11:47 user nova-compute[75257]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260] successful.
Nov 14 02:11:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ca8d1-5274-4802-99c0-23f896009031]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== disconnect_volume: return (319ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:47 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Took 0.83 seconds to deallocate network for instance.
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received event network-vif-plugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Acquiring lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] No waiting events found dispatching network-vif-plugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:47 user nova-compute[75257]: WARNING nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received unexpected event network-vif-plugged-7946fb64-2722-4b7d-a7bc-5223ad6536e5 for instance with vm_state deleted and task_state None.
Nov 14 02:11:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-unplugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] No waiting events found dispatching network-vif-unplugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:47 user nova-compute[75257]: WARNING nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received unexpected event network-vif-unplugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance with vm_state active and task_state rebuilding.
Nov 14 02:11:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] No waiting events found dispatching network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:47 user nova-compute[75257]: WARNING nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received unexpected event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance with vm_state active and task_state rebuilding.
Nov 14 02:11:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1924bacb-3473-4135-a9c2-9c4b624e82bb req-217ae769-0e0d-4527-8bc2-33b23303c8ae service nova] [instance: 1a6df88a-5599-4b10-917c-c3c0b009c3cb] Received event network-vif-deleted-7946fb64-2722-4b7d-a7bc-5223ad6536e5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Instance destroyed successfully.
Nov 14 02:11:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1741521006',display_name='tempest-ServerActionsTestOtherA-server-1571034706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1741521006',id=15,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvMChb+aecwn40wfnvjF+Z4X1IXJnC2lqu7jzDw+N4Tyc9AiF8NWxVLA5y/hDnNYJ0o67tDS/YoN1aso6ftvlo/jonqLcgPcHXmzabpe0UOICeVkW5vaXUUBYQhWe3WJQ==',key_name='tempest-keypair-808543668',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-t9n8uyh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_vif [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e7908eb-09, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfa750fa-1bf9-40f8-855c-a180b81e8d0f) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:48 user nova-compute[75257]: INFO os_vif [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09')
Nov 14 02:11:48 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Deleted allocations for instance 1a6df88a-5599-4b10-917c-c3c0b009c3cb
Nov 14 02:11:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CczKsNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:48 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9c26c8-2926-4f3b-b866-5890fb9eea00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:11:48 user nova-compute[75257]: No targets found.
Nov 14 02:11:48 user nova-compute[75257]: iSNS:
Nov 14 02:11:48 user nova-compute[75257]: No targets found.
Nov 14 02:11:48 user nova-compute[75257]: STATIC:
Nov 14 02:11:48 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:11:48 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:48 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:48 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:11:48 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:11:48 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:11:48 user nova-compute[75257]: FIRMWARE:
Nov 14 02:11:48 user nova-compute[75257]: No targets found.
Nov 14 02:11:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:11:48 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:11:48 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73830442-6124-4040-8e65-99852ec737ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a1fb4d-427c-4e78-a4fe-ced69c873ced]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:48 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:48 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c118f70>, {}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Disconnecting from: [] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== disconnect_volume: return (85ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:11:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Deleting instance files /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146_del
Nov 14 02:11:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Deletion of /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146_del complete
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8bdda24b-4516-4f50-86c8-9959d5ae8a43 tempest-TestServerVolumeAttachmentScenario-76705494 tempest-TestServerVolumeAttachmentScenario-76705494-project-member] Lock "1a6df88a-5599-4b10-917c-c3c0b009c3cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.798s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:48 user nova-compute[75257]: INFO nova.virt.block_device [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Booting with volume 57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 at /dev/vdb
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.utils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde676f9-3b75-44d3-977e-d3e68291b9a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0413739d-8b47-4847-9f08-5bd503c7eb37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2e6ceb-c4f4-46d3-9417-1a3f7be287ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[079684fc-0c8e-4f33-b345-912557e3fc1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:11:48 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:11:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[892193c5-7c4a-4742-be80-89220d75967e]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG os_brick.utils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:48 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Updating existing volume attachment record: e17d5727-42e2-4855-90a0-07cc35491148 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:11:49 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:50 user nova-compute[75257]: INFO nova.compute.manager [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Terminating instance
Nov 14 02:11:50 user nova-compute[75257]: DEBUG nova.compute.manager [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received event network-vif-unplugged-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] No waiting events found dispatching network-vif-unplugged-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-44956878-6f45-4d8d-bc96-1f2ee849949e req-f184b82b-ec00-4b79-af6b-0dc3fd2beabf service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received event network-vif-unplugged-aa2867e8-4cfe-415e-96a1-881199b73c4c for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:11:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Instance destroyed successfully.
Nov 14 02:11:51 user nova-compute[75257]: DEBUG nova.objects.instance [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lazy-loading 'resources' on Instance uuid fd62b270-19d7-45e5-bd66-a94c384050bd {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1824193926',display_name='tempest-VolumesAdminNegativeTest-server-1824193926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1824193926',id=6,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5+yRFEwVQWprnc7ODmeU3bQAwpnqUHzc+F/OioFpEEeae7IQXrZGHZi/lqSuBGwTYoGQL/HLDn56SDAvFoatTPDJemQy33iCCPDbGw0rxPRWy558FvMow3jTEevbrLpw==',key_name='tempest-keypair-1368640699',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b4120a890b64ac9abb385f0ba8d3447',ramdisk_id='',reservation_id='r-omq347zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1630669709',owner_user_name='tempest-VolumesAdminNegativeTest-1630669709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e4dbe6bba744f4cabba17fcbea21c64',uuid=fd62b270-19d7-45e5-bd66-a94c384050bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converting VIF {"id": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "address": "fa:16:3e:3b:2e:bd", "network": {"id": "18e0a90a-04a6-4a06-b7d2-6cb6b68906b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-998338305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b4120a890b64ac9abb385f0ba8d3447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2867e8-4c", "ovs_interfaceid": "aa2867e8-4cfe-415e-96a1-881199b73c4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:2e:bd,bridge_name='br-int',has_traffic_filtering=True,id=aa2867e8-4cfe-415e-96a1-881199b73c4c,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2867e8-4c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG os_vif [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:2e:bd,bridge_name='br-int',has_traffic_filtering=True,id=aa2867e8-4cfe-415e-96a1-881199b73c4c,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2867e8-4c') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa2867e8-4c, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8558909-e629-472c-85a2-bcc495166b66) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:51 user nova-compute[75257]: INFO os_vif [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:2e:bd,bridge_name='br-int',has_traffic_filtering=True,id=aa2867e8-4cfe-415e-96a1-881199b73c4c,network=Network(18e0a90a-04a6-4a06-b7d2-6cb6b68906b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2867e8-4c')
Nov 14 02:11:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Deleting instance files /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd_del
Nov 14 02:11:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Deletion of /opt/stack/data/nova/instances/fd62b270-19d7-45e5-bd66-a94c384050bd_del complete
Nov 14 02:11:51 user nova-compute[75257]: INFO nova.compute.manager [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 02:11:51 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:11:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received event network-vif-deleted-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:52 user nova-compute[75257]: INFO nova.compute.manager [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Neutron deleted interface aa2867e8-4cfe-415e-96a1-881199b73c4c; detaching it from the instance and deleting it from the info cache
Nov 14 02:11:52 user nova-compute[75257]: DEBUG nova.network.neutron [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:52 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Took 1.30 seconds to deallocate network for instance.
Nov 14 02:11:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-7d180d6a-00f3-4c28-b73a-f5e0a8e38528 req-c12864c5-63d6-44a6-8acf-2835ec607828 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Detach interface failed, port_id=aa2867e8-4cfe-415e-96a1-881199b73c4c, reason: Instance fd62b270-19d7-45e5-bd66-a94c384050bd could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received event network-vif-plugged-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] Acquiring lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] No waiting events found dispatching network-vif-plugged-aa2867e8-4cfe-415e-96a1-881199b73c4c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:52 user nova-compute[75257]: WARNING nova.compute.manager [req-3200728c-ece0-4227-9ea7-fa73109bf2ec req-56560caa-ebc5-4181-b5e9-0b933388e116 service nova] [instance: fd62b270-19d7-45e5-bd66-a94c384050bd] Received unexpected event network-vif-plugged-aa2867e8-4cfe-415e-96a1-881199b73c4c for instance with vm_state deleted and task_state None.
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:53 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Deleted allocations for instance fd62b270-19d7-45e5-bd66-a94c384050bd
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-01fb7ae8-700f-4215-a549-4e610446ce88 tempest-VolumesAdminNegativeTest-1630669709 tempest-VolumesAdminNegativeTest-1630669709-project-member] Lock "fd62b270-19d7-45e5-bd66-a94c384050bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.021s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:11:53 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Creating image(s)
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk 1073741824" returned: 0 in 0.065s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lazy-loading 'flavor' on Instance uuid d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Cannot resize image /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Ensure instance console log exists: /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Start _get_guest_xml network_info=[{"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e17d5727-42e2-4855-90a0-07cc35491148', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CczKsNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146', 'attached_at': '', 'detached_at': '', 'volume_id': '57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 'serial': '57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:11:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 02:11:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:54 user nova-compute[75257]: INFO nova.compute.manager [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Attaching volume 5dc69db0-7870-47f5-893c-3a671a567673 to /dev/vdb
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'vcpu_model' on Instance uuid b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CczKsNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:54 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 02:11:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:54 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 02:11:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:11:54 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:11:54 user nova-compute[75257]: DEBUG os_brick.utils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received event network-changed-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Refreshing instance network info cache due to event network-changed-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] Acquiring lock "refresh_cache-d89aad70-7a33-4519-8308-f9ed98031692" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] Acquired lock "refresh_cache-d89aad70-7a33-4519-8308-f9ed98031692" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG nova.network.neutron [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Refreshing network info cache for port 4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56750ef-c657-4d99-84b9-455bde25a070]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:11:54 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f68c6a-083d-49ed-ae6b-f02694160afe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[87287736-f6d3-4997-8550-58d21d5bcb3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1] added
Nov 14 02:11:54 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f32ec5-ccd5-4018-9ac7-31b0f306f8a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc851a1-691c-40df-9332-ff65110e7181]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d93e73a-e143-4e58-b466-0f023397d9ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc4d7f2-a6e3-4c4c-b6fd-faf6e325678b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5cc452-a211-4cf5-9c81-7fad501c31eb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.497s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CczKsNEl {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:11:55 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c54ba-3904-49c8-a207-903c69d31b1e]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.utils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] <== get_connector_properties: return (465ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Updating existing volume attachment record: 41ed2e5a-e6ce-4ae1-ba18-f57b58a371a7 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CczKsNEl" returned: 0 in 0.099s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce16c7c8-f9af-4132-8397-82713bb71e22]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CczKsNEl'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2f3a01-cc16-424d-a70e-a7ae1a15c9e6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4265a958-c791-419b-b28a-ddfe01515d76]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:55 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:55 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db46b2a-b3b5-4371-ba49-c4f654be2658]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260]
Nov 14 02:11:55 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260] successful.
Nov 14 02:11:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.049s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[427b2049-241c-4834-b6be-56452dfc275e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[758416bc-6b28-425a-9e06-2d623759f89b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:55 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:55 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:11:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:11:55 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:11:55 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:11:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.752s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dcf3a9-4871-47be-b071-9680075eb1de]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CczKsNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Updated VIF entry in instance network info cache for port 4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Updating instance_info_cache with network_info: [{"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:11:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-369280e4-0e78-4909-b0ec-5cad9455027b req-21b203b2-d97e-4f2f-b062-92280cdb42f5 service nova] Releasing lock "refresh_cache-d89aad70-7a33-4519-8308-f9ed98031692" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:56 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:11:56 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7963MB free_disk=25.373584747314453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 71a9d20f-e79b-4716-abf8-a15330742167 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2f9df98c-7814-419d-8821-d8c571972f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance d89aad70-7a33-4519-8308-f9ed98031692 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.784s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== connect_volume: return (1786ms) {'type': 'block', 'scsi_wwn': '23636333937623938', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636333937623938', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1741521006',display_name='tempest-ServerActionsTestOtherA-server-1571034706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1741521006',id=15,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvMChb+aecwn40wfnvjF+Z4X1IXJnC2lqu7jzDw+N4Tyc9AiF8NWxVLA5y/hDnNYJ0o67tDS/YoN1aso6ftvlo/jonqLcgPcHXmzabpe0UOICeVkW5vaXUUBYQhWe3WJQ==',key_name='tempest-keypair-808543668',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-t9n8uyh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:11:56 user nova-compute[75257]:   <uuid>b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146</uuid>
Nov 14 02:11:56 user nova-compute[75257]:   <name>instance-0000000f</name>
Nov 14 02:11:56 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:11:56 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:11:56 user nova-compute[75257]:   <metadata>
Nov 14 02:11:56 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:11:56 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:11:56 user nova-compute[75257]:       <nova:name>tempest-ServerActionsTestOtherA-server-1571034706</nova:name>
Nov 14 02:11:56 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:11:54</nova:creationTime>
Nov 14 02:11:56 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:11:56 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:11:56 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:11:56 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:11:56 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:11:56 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:11:56 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:11:56 user nova-compute[75257]:       <nova:owner>
Nov 14 02:11:56 user nova-compute[75257]:         <nova:user uuid="7ffa5574e531479993ef301510f1d9e3">tempest-ServerActionsTestOtherA-1988221692-project-member</nova:user>
Nov 14 02:11:56 user nova-compute[75257]:         <nova:project uuid="a1ba9547629f4ea1b40424e277e17d25">tempest-ServerActionsTestOtherA-1988221692</nova:project>
Nov 14 02:11:56 user nova-compute[75257]:       </nova:owner>
Nov 14 02:11:56 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:11:56 user nova-compute[75257]:       <nova:ports>
Nov 14 02:11:56 user nova-compute[75257]:         <nova:port uuid="6e7908eb-09c1-4662-b587-2a28838e6ca6">
Nov 14 02:11:56 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 02:11:56 user nova-compute[75257]:         </nova:port>
Nov 14 02:11:56 user nova-compute[75257]:       </nova:ports>
Nov 14 02:11:56 user nova-compute[75257]:     </nova:instance>
Nov 14 02:11:56 user nova-compute[75257]:   </metadata>
Nov 14 02:11:56 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:11:56 user nova-compute[75257]:     <system>
Nov 14 02:11:56 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:11:56 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:11:56 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:11:56 user nova-compute[75257]:       <entry name="serial">b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146</entry>
Nov 14 02:11:56 user nova-compute[75257]:       <entry name="uuid">b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146</entry>
Nov 14 02:11:56 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:11:56 user nova-compute[75257]:     </system>
Nov 14 02:11:56 user nova-compute[75257]:   </sysinfo>
Nov 14 02:11:56 user nova-compute[75257]:   <os>
Nov 14 02:11:56 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:11:56 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:11:56 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:11:56 user nova-compute[75257]:   </os>
Nov 14 02:11:56 user nova-compute[75257]:   <features>
Nov 14 02:11:56 user nova-compute[75257]:     <acpi/>
Nov 14 02:11:56 user nova-compute[75257]:     <apic/>
Nov 14 02:11:56 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:11:56 user nova-compute[75257]:   </features>
Nov 14 02:11:56 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:11:56 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:11:56 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:11:56 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:11:56 user nova-compute[75257]:   </clock>
Nov 14 02:11:56 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:11:56 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:11:56 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:11:56 user nova-compute[75257]:   </cpu>
Nov 14 02:11:56 user nova-compute[75257]:   <devices>
Nov 14 02:11:56 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:11:56 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:11:56 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk"/>
Nov 14 02:11:56 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:11:56 user nova-compute[75257]:     </disk>
Nov 14 02:11:56 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:11:56 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:11:56 user nova-compute[75257]:       <source dev="/dev/sdb"/>
Nov 14 02:11:56 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:11:56 user nova-compute[75257]:       <serial>57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1</serial>
Nov 14 02:11:56 user nova-compute[75257]:     </disk>
Nov 14 02:11:56 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:11:56 user nova-compute[75257]:       <mac address="fa:16:3e:a5:e0:91"/>
Nov 14 02:11:56 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:11:56 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:11:56 user nova-compute[75257]:       <target dev="tap6e7908eb-09"/>
Nov 14 02:11:56 user nova-compute[75257]:     </interface>
Nov 14 02:11:56 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:11:56 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/console.log" append="off"/>
Nov 14 02:11:56 user nova-compute[75257]:     </serial>
Nov 14 02:11:56 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:11:56 user nova-compute[75257]:     <video>
Nov 14 02:11:56 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:11:56 user nova-compute[75257]:     </video>
Nov 14 02:11:56 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:11:56 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:11:56 user nova-compute[75257]:     </rng>
Nov 14 02:11:56 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:11:56 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:11:56 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:11:56 user nova-compute[75257]:     </memballoon>
Nov 14 02:11:56 user nova-compute[75257]:   </devices>
Nov 14 02:11:56 user nova-compute[75257]: </domain>
Nov 14 02:11:56 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1741521006',display_name='tempest-ServerActionsTestOtherA-server-1571034706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1741521006',id=15,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvMChb+aecwn40wfnvjF+Z4X1IXJnC2lqu7jzDw+N4Tyc9AiF8NWxVLA5y/hDnNYJ0o67tDS/YoN1aso6ftvlo/jonqLcgPcHXmzabpe0UOICeVkW5vaXUUBYQhWe3WJQ==',key_name='tempest-keypair-808543668',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-t9n8uyh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG os_vif [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d3f12bd-bee5-5b72-80ed-da91220f151f', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e7908eb-09, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e7908eb-09, col_values=(('qos', UUID('1db009b3-5444-490b-9e88-f8f3f8d6b672')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e7908eb-09, col_values=(('external_ids', {'iface-id': '6e7908eb-09c1-4662-b587-2a28838e6ca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:e0:91', 'vm-uuid': 'b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:56 user nova-compute[75257]: INFO os_vif [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09')
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No VIF found with MAC fa:16:3e:a5:e0:91, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:11:56 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:11:57 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:11:57 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:11:57 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:11:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] No waiting events found dispatching network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:11:58 user nova-compute[75257]: WARNING nova.compute.manager [req-c24b3093-119c-4ff8-8e85-91277f9c3cc4 req-88f59c93-66e2-415a-9f08-b18c166bf414 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received unexpected event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 02:11:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:11:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLSeWiDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:00 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:00 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:00 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cec02a-c45d-4377-8b71-c36863648a6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:12:00 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[75871460-8650-4764-a81f-41be708a991f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673] added
Nov 14 02:12:00 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae42f308-353c-48eb-a768-e705ce49ddac]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d5e6a3-35cf-4d21-89a2-08f5722efbba]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLSeWiDF {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLSeWiDF" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d78cc5f-0a15-4a9e-95ce-d738f6a6b4e9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mLSeWiDF'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[590d5ac3-a3e7-4d1e-bc22-af56f7e8027c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[750a9b12-138f-48b7-a361-25a2a5adb970]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:00 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:00 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[93155426-cff6-46d5-9c38-4a5e4ab6ef81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260]
Nov 14 02:12:00 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260] successful.
Nov 14 02:12:00 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e6a47e-b3a0-45f7-ade3-11b8c15f45ed]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a58fd27-52fc-402a-ae0d-2b45b95a4d31]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:00 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:00 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:00 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e06f72-b714-46a2-965b-3ce6d7696323]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLSeWiDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:12:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Instance spawned successfully.
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] No waiting events found dispatching network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:12:00 user nova-compute[75257]: WARNING nova.compute.manager [req-77c17c19-4bdc-4962-93b6-12b2e0da40ff req-dd5f3689-3e90-43a8-b913-0081c7eb7ece service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received unexpected event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75257) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9c21ace-33db-4e6d-96a1-b9c8235b700a tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.069s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:12:00 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 71a9d20f-e79b-4716-abf8-a15330742167 is timed out.
Nov 14 02:12:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully detached device vdb from instance 71a9d20f-e79b-4716-abf8-a15330742167 from the live domain config.
Nov 14 02:12:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDKHQIqE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:00 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23631346231613061', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631346231613061', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.530s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lazy-loading 'flavor' on Instance uuid d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfadfc7-861a-4e57-b9dc-9296da6243ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:12:01 user nova-compute[75257]: No targets found.
Nov 14 02:12:01 user nova-compute[75257]: iSNS:
Nov 14 02:12:01 user nova-compute[75257]: No targets found.
Nov 14 02:12:01 user nova-compute[75257]: STATIC:
Nov 14 02:12:01 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb
Nov 14 02:12:01 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:01 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:01 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:12:01 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:01 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:01 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673
Nov 14 02:12:01 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:01 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:01 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:12:01 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:01 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:01 user nova-compute[75257]: FIRMWARE:
Nov 14 02:12:01 user nova-compute[75257]: No targets found.
Nov 14 02:12:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:12:01 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:12:01 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:12:01 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:12:01 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:12:01 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:12:01 user nova-compute[75257]:   <serial>5dc69db0-7870-47f5-893c-3a671a567673</serial>
Nov 14 02:12:01 user nova-compute[75257]: </disk>
Nov 14 02:12:01 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b9bda-1ce6-4f39-9355-e40b7a431f95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[044844d7-e867-4e06-8af3-c582999caa38]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:01 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:12:01 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:01 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:01 user nova-compute[75257]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb (non-flash)
Nov 14 02:12:01 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:01 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3b36d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb'): ({'sdd'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Removing single pathed devices sdd {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf9a354-78f6-4f11-90b4-d0dd2b3faecd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e0706a-4079-4837-8f4f-531afa7322d2]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flushing IO for device /dev/sdd {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0208b42f-cf7a-45a9-b0c0-6c23c15c5de5]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[978dc1ea-c20e-40bf-a4f1-55d6e4d0b721]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] SCSI volumes sdd have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c8dbe2-6943-411b-8f8e-1c9516152483]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6310fd9-ef70-4977-a160-db05e01bb1ea]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260]
Nov 14 02:12:01 user nova-compute[75257]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb, portal: 172.16.0.220,3260] successful.
Nov 14 02:12:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:399fd6d1-cc6f-432c-96c2-eb97da1c0ceb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede33dc-e67a-4573-b6f5-c16f9a2a88d6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== disconnect_volume: return (889ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] No VIF found with MAC fa:16:3e:60:d3:97, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:12:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6b1f708e-7354-4753-ae18-2ba765d62eb3 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.172s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:02 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:12:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b3e21630-1063-47b4-9b6a-cde1e93a582b tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.334s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "d89aad70-7a33-4519-8308-f9ed98031692" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG os_brick.utils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75257) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.049s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf7f4c0-54f0-4e0d-b7bb-6c996544938f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf6b06d-845c-4762-8252-8d83f4713fe7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75af93e-dc64-436f-ae81-6599ac7acefc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[09446a46-c686-4990-823a-5e9cca6cae7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:12:03 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d1979e-f5a6-4929-9554-d60545348318]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG os_brick.utils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] <== get_connector_properties: return (239ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:03 user nova-compute[75257]: INFO nova.compute.manager [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Swapping volume 5dc69db0-7870-47f5-893c-3a671a567673 for 86f47159-12bc-4ff4-914f-c03163dcf3e6
Nov 14 02:12:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-unplugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-unplugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:12:03 user nova-compute[75257]: WARNING nova.compute.manager [req-d09f35e2-d8fb-4550-b064-714c48900a62 req-22e6ef60-0b66-40b5-aef7-ea081b237f17 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-unplugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state active and task_state powering-off.
Nov 14 02:12:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance destroyed successfully.
Nov 14 02:12:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:12:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b829045-de4b-4056-8e46-ee2228427f94 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.098s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:12:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:12:05 user nova-compute[75257]: WARNING nova.compute.manager [req-4f3890cc-bc15-40f7-bc83-d8707e742932 req-d2b48b1f-cd58-4005-a585-536aa642b5a3 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state stopped and task_state None.
Nov 14 02:12:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 2f9df98c-7814-419d-8821-d8c571972f0e {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 42cdcf9f-848c-4960-87ca-3a8afa145b6a {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "71a9d20f-e79b-4716-abf8-a15330742167" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "2f9df98c-7814-419d-8821-d8c571972f0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "2f9df98c-7814-419d-8821-d8c571972f0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "2f9df98c-7814-419d-8821-d8c571972f0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "71a9d20f-e79b-4716-abf8-a15330742167" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ewshokzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd89aad70-7a33-4519-8308-f9ed98031692', 'attached_at': '', 'detached_at': '', 'volume_id': '86f47159-12bc-4ff4-914f-c03163dcf3e6', 'serial': '86f47159-12bc-4ff4-914f-c03163dcf3e6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLSeWiDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd89aad70-7a33-4519-8308-f9ed98031692', 'attached_at': '', 'detached_at': '', 'volume_id': '5dc69db0-7870-47f5-893c-3a671a567673', 'serial'} {{(pid=75257) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ewshokzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:08 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:08 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:08 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9c75f3-0308-44d6-89ce-66f346bebdc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:12:08 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[96973843-2cb7-4704-8fde-e407100e9991]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6] added
Nov 14 02:12:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[debc9a99-73c5-47c1-b0b8-8ad509f1a013]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a937ab-baac-4ff7-9613-cd30e752cf51]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ewshokzi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ewshokzi" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[91869198-0f53-425c-a55f-0177a0bdfcb3]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Ewshokzi'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd0ef9b-2e01-468e-a59f-4e33ad127e7b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ca0db-c222-4f1d-8d39-d3ddf5b18b1e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[113167bb-c568-4b13-8a00-6b998606efc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6, portal: 172.16.0.220,3260]
Nov 14 02:12:08 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6, portal: 172.16.0.220,3260] successful.
Nov 14 02:12:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d17ef0-e362-4bfd-98a3-b1b05269f319]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e0191-2c92-4e21-a260-f81a4bfe6a12]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58e1e50-a023-4f66-95fb-f84c27b55b22]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:08 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:12:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:12:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ewshokzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:12:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23435376261343032', 'path': '/dev/sdd'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435376261343032', 'path': '/dev/sdd'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:12:09 user nova-compute[75257]: DEBUG nova.objects.instance [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lazy-loading 'flavor' on Instance uuid d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:12:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 16777216 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 175112192 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 332398592 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 472907776 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 608174080 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 742391808 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 911212544 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLSeWiDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:13 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[21626e88-c48b-45f3-b24b-385527704ad1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:12:13 user nova-compute[75257]: No targets found.
Nov 14 02:12:13 user nova-compute[75257]: iSNS:
Nov 14 02:12:13 user nova-compute[75257]: No targets found.
Nov 14 02:12:13 user nova-compute[75257]: STATIC:
Nov 14 02:12:13 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:12:13 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:13 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:13 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673
Nov 14 02:12:13 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:13 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:13 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6
Nov 14 02:12:13 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:13 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:13 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:12:13 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:13 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:13 user nova-compute[75257]: FIRMWARE:
Nov 14 02:12:13 user nova-compute[75257]: No targets found.
Nov 14 02:12:13 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:12:13 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:12:13 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2af487-432b-4461-b81e-379cd2d7798b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed37017-af80-46c3-bfd6-9c42338e474f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:13 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:13 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:13 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:13 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:13 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:13 user nova-compute[75257]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:13 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:13 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3b00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd4e553-35be-4a37-a466-25eaf075d989]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d11e23-b351-48c8-8d89-b8fa486f8d39]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:13 user nova-compute[75257]: INFO nova.compute.manager [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Detaching volume 6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8bf1c4-82e9-4a2f-b54e-164706d14dbc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb38b36-0759-4b67-bd0a-bf1a29863a86]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:12:13 user nova-compute[75257]: INFO nova.virt.block_device [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Attempting to driver detach volume 6a26d0df-3e86-4e5e-bd0d-5deae5534d5a from mountpoint /dev/vdb
Nov 14 02:12:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Attempting to detach device vdb from instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:12:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:12:13 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:12:13 user nova-compute[75257]:   <source dev="/dev/sdg"/>
Nov 14 02:12:13 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:12:13 user nova-compute[75257]:   <serial>6a26d0df-3e86-4e5e-bd0d-5deae5534d5a</serial>
Nov 14 02:12:13 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:12:13 user nova-compute[75257]: </disk>
Nov 14 02:12:13 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:12:14 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Successfully detached device vdb from instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 from the persistent domain config.
Nov 14 02:12:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:12:14 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:12:14 user nova-compute[75257]:   <source dev="/dev/sdg"/>
Nov 14 02:12:14 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:12:14 user nova-compute[75257]:   <serial>6a26d0df-3e86-4e5e-bd0d-5deae5534d5a</serial>
Nov 14 02:12:14 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:12:14 user nova-compute[75257]: </disk>
Nov 14 02:12:14 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f480afe-3348-499b-ab44-5ae4086814d7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b182a0fd-1b89-4697-add5-0ec5274be425]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260]
Nov 14 02:12:14 user nova-compute[75257]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260] successful.
Nov 14 02:12:14 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfdc838-c05a-45c9-abfc-58f574e8132c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] <== disconnect_volume: return (337ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ewshokzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd89aad70-7a33-4519-8308-f9ed98031692', 'attached_at': '', 'detached_at': '', 'volume_id': '86f47159-12bc-4ff4-914f-c03163dcf3e6', 'serial'} {{(pid=75257) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] swap_volume: removing Cinder connection for volume 5dc69db0-7870-47f5-893c-3a671a567673 {{(pid=75257) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 02:12:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:12:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] swap_volume: Updating volume 5dc69db0-7870-47f5-893c-3a671a567673 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "Ewshokzi", "auth_password": "fYX104PGZivMc9", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "86f47159-12bc-4ff4-914f-c03163dcf3e6"}, "status": "reserved", "instance": "d89aad70-7a33-4519-8308-f9ed98031692", "attached_at": "", "detached_at": "", "volume_id": "86f47159-12bc-4ff4-914f-c03163dcf3e6", "serial": "86f47159-12bc-4ff4-914f-c03163dcf3e6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '86f47159-12bc-4ff4-914f-c03163dcf3e6', 'no_device': None, 'attachment_id': 'a570a7da-a10a-4fec-82fc-ce256346d9e0'} {{(pid=75257) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 02:12:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-68fe8355-9e46-4b70-8408-5d74efba1bb3 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "d89aad70-7a33-4519-8308-f9ed98031692" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.830s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "d89aad70-7a33-4519-8308-f9ed98031692" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.174s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "d89aad70-7a33-4519-8308-f9ed98031692" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "d89aad70-7a33-4519-8308-f9ed98031692" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG os_brick.utils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[553391a7-d28a-49ab-a133-91419124a956]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7056b33d-d9ca-4908-9a51-d23aac7ce476]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d4ff1-482c-4670-8631-73e73a0fca98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a629918-91d1-41c4-b1f6-9d0a4d6e8d55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:12:16 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:12:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e6ac7b-d40c-4746-97fc-2d9777ef04b5]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:12:16 user nova-compute[75257]: DEBUG os_brick.utils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:16 user nova-compute[75257]: INFO nova.compute.manager [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Swapping volume 86f47159-12bc-4ff4-914f-c03163dcf3e6 for 5dc69db0-7870-47f5-893c-3a671a567673
Nov 14 02:12:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLSeWiDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd89aad70-7a33-4519-8308-f9ed98031692', 'attached_at': '', 'detached_at': '', 'volume_id': '5dc69db0-7870-47f5-893c-3a671a567673', 'serial': '5dc69db0-7870-47f5-893c-3a671a567673'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ewshokzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '86f47159-12bc-4ff4-914f-c03163dcf3e6'}, 'status': 'reserved', 'instance': 'd89aad70-7a33-4519-8308-f9ed98031692', 'attached_at': '', 'detached_at': '', 'volume_id': '86f47159-12bc-4ff4-914f-c03163dcf3e6', 'serial'} {{(pid=75257) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLSeWiDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:20 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:20 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:20 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc5d31c-f435-4a31-acea-5a73d19600f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:12:20 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c42462-5aa0-4ada-b99b-b04481c256a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673] added
Nov 14 02:12:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d96055-42e1-42ec-8142-cfe331ea33b1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[277dbb51-78bf-4172-9c68-cf7cdea337e5]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLSeWiDF {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mLSeWiDF" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8056504-0a79-466f-88f3-f3672d5e1ee1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mLSeWiDF'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[403bb74b-606d-4bed-82a4-317a3db5b34b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[43944979-47ce-43b2-b072-9fb0ec26d83b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeadf7e-b7bf-4790-a40d-0ea323cc6af5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260]
Nov 14 02:12:21 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260] successful.
Nov 14 02:12:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a779800-1d53-44d0-bec5-7beb31b9b542]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[77143ae7-7a9a-4d86-b13c-b99430b46d8e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdea50b-edf8-42df-8c12-8b56e165f79a]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:22 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:12:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLSeWiDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:12:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23631346231613061', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631346231613061', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:12:22 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lazy-loading 'flavor' on Instance uuid d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:12:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 150994944 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 344981504 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 527433728 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 708837376 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 867172352 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 1009778688 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ewshokzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '86f47159-12bc-4ff4-914f-c03163dcf3e6'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:26 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1240b9cd-e713-4d99-8ec6-e3769837c68f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:12:26 user nova-compute[75257]: No targets found.
Nov 14 02:12:26 user nova-compute[75257]: iSNS:
Nov 14 02:12:26 user nova-compute[75257]: No targets found.
Nov 14 02:12:26 user nova-compute[75257]: STATIC:
Nov 14 02:12:26 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:12:26 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:26 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:26 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673
Nov 14 02:12:26 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:26 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:26 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6
Nov 14 02:12:26 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:26 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:26 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:12:26 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:26 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:26 user nova-compute[75257]: FIRMWARE:
Nov 14 02:12:26 user nova-compute[75257]: No targets found.
Nov 14 02:12:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:12:26 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:12:26 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[301f7b15-357a-481e-8a1c-6f89977da55a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5db4a5-d88d-4615-9b17-70086f31b68a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:26 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:26 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:26 user nova-compute[75257]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:26 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:26 user nova-compute[75257]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 (non-flash)
Nov 14 02:12:26 user nova-compute[75257]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3c8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6'): ({'sdd'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Removing single pathed devices sdd {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cfa5f5-a6fd-47f8-ba91-03ae8d052568]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[96468904-52a3-48d1-a322-6809584f7037]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Flushing IO for device /dev/sdd {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e481bc3-4ccb-40bb-b86d-186ee5375dbf]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[105aa360-1113-4ae5-9606-652d547dd885]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] SCSI volumes sdd have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea28ab-c5a1-449c-9906-f1612d671cd3]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0b8572-8adf-4240-b0eb-0c6f93390d06]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6, portal: 172.16.0.220,3260]
Nov 14 02:12:26 user nova-compute[75257]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6, portal: 172.16.0.220,3260] successful.
Nov 14 02:12:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86f47159-12bc-4ff4-914f-c03163dcf3e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5180f55-0ea5-4d82-bcf8-2f0936a02729]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] <== disconnect_volume: return (351ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLSeWiDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd89aad70-7a33-4519-8308-f9ed98031692', 'attached_at': '', 'detached_at': '', 'volume_id': '5dc69db0-7870-47f5-893c-3a671a567673', 'serial'} {{(pid=75257) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] swap_volume: removing Cinder connection for volume 86f47159-12bc-4ff4-914f-c03163dcf3e6 {{(pid=75257) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:27 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] [instance: d89aad70-7a33-4519-8308-f9ed98031692] swap_volume: Updating volume 86f47159-12bc-4ff4-914f-c03163dcf3e6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "mLSeWiDF", "auth_password": "PVIAH29UkQp7oz", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "5dc69db0-7870-47f5-893c-3a671a567673"}, "status": "reserved", "instance": "d89aad70-7a33-4519-8308-f9ed98031692", "attached_at": "", "detached_at": "", "volume_id": "5dc69db0-7870-47f5-893c-3a671a567673", "serial": "5dc69db0-7870-47f5-893c-3a671a567673"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5dc69db0-7870-47f5-893c-3a671a567673', 'no_device': None, 'attachment_id': '6049161a-5f93-46f5-9b17-177aec7a394c'} {{(pid=75257) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 02:12:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1955a325-a377-4964-a625-62bef1bea0a9 tempest-TestVolumeSwap-73243363 tempest-TestVolumeSwap-73243363-project-admin] Lock "d89aad70-7a33-4519-8308-f9ed98031692" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.103s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:12:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:12:28 user nova-compute[75257]: INFO nova.compute.claims [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Claim successful on node user
Nov 14 02:12:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:28 user nova-compute[75257]: INFO nova.compute.manager [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Detaching volume 5dc69db0-7870-47f5-893c-3a671a567673
Nov 14 02:12:28 user nova-compute[75257]: INFO nova.virt.block_device [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Attempting to driver detach volume 5dc69db0-7870-47f5-893c-3a671a567673 from mountpoint /dev/vdb
Nov 14 02:12:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Attempting to detach device vdb from instance d89aad70-7a33-4519-8308-f9ed98031692 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:12:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:12:28 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:12:28 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:12:28 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:12:28 user nova-compute[75257]:   <serial>5dc69db0-7870-47f5-893c-3a671a567673</serial>
Nov 14 02:12:28 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:12:28 user nova-compute[75257]: </disk>
Nov 14 02:12:28 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:12:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Successfully detached device vdb from instance d89aad70-7a33-4519-8308-f9ed98031692 from the persistent domain config.
Nov 14 02:12:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d89aad70-7a33-4519-8308-f9ed98031692 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:12:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:12:28 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:12:28 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:12:28 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:12:28 user nova-compute[75257]:   <serial>5dc69db0-7870-47f5-893c-3a671a567673</serial>
Nov 14 02:12:28 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:12:28 user nova-compute[75257]: </disk>
Nov 14 02:12:28 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:12:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.policy [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:12:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Creating image(s)
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:12:29 user nova-compute[75257]: INFO nova.compute.claims [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Claim successful on node user
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Successfully created port: 775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk 1073741824" returned: 0 in 0.054s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:12:29 user nova-compute[75257]: DEBUG nova.network.neutron [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:12:30 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.policy [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Cannot resize image /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Ensure instance console log exists: /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:12:30 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Creating image(s)
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Successfully updated port: 775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquired lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-changed-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Refreshing instance network info cache due to event network-changed-775872ee-1599-4358-9d11-07252d3855ce. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] Acquiring lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.196s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.165s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk 1073741824" returned: 0 in 0.062s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.neutron [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Successfully created port: 38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updating instance_info_cache with network_info: [{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Releasing lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Instance network_info: |[{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] Acquired lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.neutron [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Refreshing network info cache for port 775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Start _get_guest_xml network_info=[{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:12:30 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:12:30 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1099099117',display_name='tempest-ServerRescueNegativeTestJSON-server-1099099117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1099099117',id=19,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-ls19w9yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:12:29Z,user_data=None,user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e4:fb,bridge_name='br-int',has_traffic_filtering=True,id=775872ee-1599-4358-9d11-07252d3855ce,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775872ee-15') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'pci_devices' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:12:30 user nova-compute[75257]:   <uuid>91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef</uuid>
Nov 14 02:12:30 user nova-compute[75257]:   <name>instance-00000013</name>
Nov 14 02:12:30 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:12:30 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:12:30 user nova-compute[75257]:   <metadata>
Nov 14 02:12:30 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:12:30 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:12:30 user nova-compute[75257]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1099099117</nova:name>
Nov 14 02:12:30 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:12:30</nova:creationTime>
Nov 14 02:12:30 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:12:30 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:12:30 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:12:30 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:12:30 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:12:30 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:12:30 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:12:30 user nova-compute[75257]:       <nova:owner>
Nov 14 02:12:30 user nova-compute[75257]:         <nova:user uuid="a5f8a4942cb54c9aa5377e6d2df1aa7b">tempest-ServerRescueNegativeTestJSON-66746497-project-member</nova:user>
Nov 14 02:12:30 user nova-compute[75257]:         <nova:project uuid="68ac9795cbe748fc8079de4bb8234cd3">tempest-ServerRescueNegativeTestJSON-66746497</nova:project>
Nov 14 02:12:30 user nova-compute[75257]:       </nova:owner>
Nov 14 02:12:30 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:12:30 user nova-compute[75257]:       <nova:ports>
Nov 14 02:12:30 user nova-compute[75257]:         <nova:port uuid="775872ee-1599-4358-9d11-07252d3855ce">
Nov 14 02:12:30 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 02:12:30 user nova-compute[75257]:         </nova:port>
Nov 14 02:12:30 user nova-compute[75257]:       </nova:ports>
Nov 14 02:12:30 user nova-compute[75257]:     </nova:instance>
Nov 14 02:12:30 user nova-compute[75257]:   </metadata>
Nov 14 02:12:30 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:12:30 user nova-compute[75257]:     <system>
Nov 14 02:12:30 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:12:30 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:12:30 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:12:30 user nova-compute[75257]:       <entry name="serial">91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef</entry>
Nov 14 02:12:30 user nova-compute[75257]:       <entry name="uuid">91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef</entry>
Nov 14 02:12:30 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:12:30 user nova-compute[75257]:     </system>
Nov 14 02:12:30 user nova-compute[75257]:   </sysinfo>
Nov 14 02:12:30 user nova-compute[75257]:   <os>
Nov 14 02:12:30 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:12:30 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:12:30 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:12:30 user nova-compute[75257]:   </os>
Nov 14 02:12:30 user nova-compute[75257]:   <features>
Nov 14 02:12:30 user nova-compute[75257]:     <acpi/>
Nov 14 02:12:30 user nova-compute[75257]:     <apic/>
Nov 14 02:12:30 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:12:30 user nova-compute[75257]:   </features>
Nov 14 02:12:30 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:12:30 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:12:30 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:12:30 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:12:30 user nova-compute[75257]:   </clock>
Nov 14 02:12:30 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:12:30 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:12:30 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:12:30 user nova-compute[75257]:   </cpu>
Nov 14 02:12:30 user nova-compute[75257]:   <devices>
Nov 14 02:12:30 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:12:30 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:12:30 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk"/>
Nov 14 02:12:30 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:12:30 user nova-compute[75257]:     </disk>
Nov 14 02:12:30 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:12:30 user nova-compute[75257]:       <mac address="fa:16:3e:16:e4:fb"/>
Nov 14 02:12:30 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:12:30 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:12:30 user nova-compute[75257]:       <target dev="tap775872ee-15"/>
Nov 14 02:12:30 user nova-compute[75257]:     </interface>
Nov 14 02:12:30 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:12:30 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/console.log" append="off"/>
Nov 14 02:12:30 user nova-compute[75257]:     </serial>
Nov 14 02:12:30 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:12:30 user nova-compute[75257]:     <video>
Nov 14 02:12:30 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:12:30 user nova-compute[75257]:     </video>
Nov 14 02:12:30 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:12:30 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:12:30 user nova-compute[75257]:     </rng>
Nov 14 02:12:30 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:12:30 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:12:30 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:12:30 user nova-compute[75257]:     </memballoon>
Nov 14 02:12:30 user nova-compute[75257]:   </devices>
Nov 14 02:12:30 user nova-compute[75257]: </domain>
Nov 14 02:12:30 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1099099117',display_name='tempest-ServerRescueNegativeTestJSON-server-1099099117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1099099117',id=19,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-ls19w9yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:12:29Z,user_data=None,user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:e4:fb,bridge_name='br-int',has_traffic_filtering=True,id=775872ee-1599-4358-9d11-07252d3855ce,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775872ee-15') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG os_vif [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e4:fb,bridge_name='br-int',has_traffic_filtering=True,id=775872ee-1599-4358-9d11-07252d3855ce,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775872ee-15') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f17753e3-af34-5cb4-8ea0-e2d179d49052', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap775872ee-15, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap775872ee-15, col_values=(('qos', UUID('adacda9c-9865-42bd-a597-034aa8d85531')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap775872ee-15, col_values=(('external_ids', {'iface-id': '775872ee-1599-4358-9d11-07252d3855ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:e4:fb', 'vm-uuid': '91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:30 user nova-compute[75257]: INFO os_vif [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:e4:fb,bridge_name='br-int',has_traffic_filtering=True,id=775872ee-1599-4358-9d11-07252d3855ce,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775872ee-15')
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No VIF found with MAC fa:16:3e:16:e4:fb, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Cannot resize image /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Ensure instance console log exists: /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.neutron [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updated VIF entry in instance network info cache for port 775872ee-1599-4358-9d11-07252d3855ce. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.neutron [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updating instance_info_cache with network_info: [{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c176be8a-5deb-4169-992e-edeadff0dec6 req-753bdadb-7add-459c-a632-e9dcde641d47 service nova] Releasing lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Successfully updated port: 38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquired lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-changed-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Refreshing instance network info cache due to event network-changed-38baa7d3-e79c-48c0-a478-d946f09f9787. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] Acquiring lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updating instance_info_cache with network_info: [{"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Releasing lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Instance network_info: |[{"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] Acquired lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.neutron [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Refreshing network info cache for port 38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Start _get_guest_xml network_info=[{"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:12:31 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:12:31 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-439193571',display_name='tempest-ServerRescueNegativeTestJSON-server-439193571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-439193571',id=20,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-c10r056v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:12:30Z,user_data=None,user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=aef5782b-9a73-4309-a559-4a81d3c5ce2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=38baa7d3-e79c-48c0-a478-d946f09f9787,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38baa7d3-e7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.objects.instance [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'pci_devices' on Instance uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:12:31 user nova-compute[75257]:   <uuid>aef5782b-9a73-4309-a559-4a81d3c5ce2e</uuid>
Nov 14 02:12:31 user nova-compute[75257]:   <name>instance-00000014</name>
Nov 14 02:12:31 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:12:31 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:12:31 user nova-compute[75257]:   <metadata>
Nov 14 02:12:31 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:12:31 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:12:31 user nova-compute[75257]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-439193571</nova:name>
Nov 14 02:12:31 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:12:31</nova:creationTime>
Nov 14 02:12:31 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:12:31 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:12:31 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:12:31 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:12:31 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:12:31 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:12:31 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:12:31 user nova-compute[75257]:       <nova:owner>
Nov 14 02:12:31 user nova-compute[75257]:         <nova:user uuid="a5f8a4942cb54c9aa5377e6d2df1aa7b">tempest-ServerRescueNegativeTestJSON-66746497-project-member</nova:user>
Nov 14 02:12:31 user nova-compute[75257]:         <nova:project uuid="68ac9795cbe748fc8079de4bb8234cd3">tempest-ServerRescueNegativeTestJSON-66746497</nova:project>
Nov 14 02:12:31 user nova-compute[75257]:       </nova:owner>
Nov 14 02:12:31 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:12:31 user nova-compute[75257]:       <nova:ports>
Nov 14 02:12:31 user nova-compute[75257]:         <nova:port uuid="38baa7d3-e79c-48c0-a478-d946f09f9787">
Nov 14 02:12:31 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 02:12:31 user nova-compute[75257]:         </nova:port>
Nov 14 02:12:31 user nova-compute[75257]:       </nova:ports>
Nov 14 02:12:31 user nova-compute[75257]:     </nova:instance>
Nov 14 02:12:31 user nova-compute[75257]:   </metadata>
Nov 14 02:12:31 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:12:31 user nova-compute[75257]:     <system>
Nov 14 02:12:31 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:12:31 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:12:31 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:12:31 user nova-compute[75257]:       <entry name="serial">aef5782b-9a73-4309-a559-4a81d3c5ce2e</entry>
Nov 14 02:12:31 user nova-compute[75257]:       <entry name="uuid">aef5782b-9a73-4309-a559-4a81d3c5ce2e</entry>
Nov 14 02:12:31 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:12:31 user nova-compute[75257]:     </system>
Nov 14 02:12:31 user nova-compute[75257]:   </sysinfo>
Nov 14 02:12:31 user nova-compute[75257]:   <os>
Nov 14 02:12:31 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:12:31 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:12:31 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:12:31 user nova-compute[75257]:   </os>
Nov 14 02:12:31 user nova-compute[75257]:   <features>
Nov 14 02:12:31 user nova-compute[75257]:     <acpi/>
Nov 14 02:12:31 user nova-compute[75257]:     <apic/>
Nov 14 02:12:31 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:12:31 user nova-compute[75257]:   </features>
Nov 14 02:12:31 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:12:31 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:12:31 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:12:31 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:12:31 user nova-compute[75257]:   </clock>
Nov 14 02:12:31 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:12:31 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:12:31 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:12:31 user nova-compute[75257]:   </cpu>
Nov 14 02:12:31 user nova-compute[75257]:   <devices>
Nov 14 02:12:31 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:12:31 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:12:31 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk"/>
Nov 14 02:12:31 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:12:31 user nova-compute[75257]:     </disk>
Nov 14 02:12:31 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:12:31 user nova-compute[75257]:       <mac address="fa:16:3e:68:bd:de"/>
Nov 14 02:12:31 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:12:31 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:12:31 user nova-compute[75257]:       <target dev="tap38baa7d3-e7"/>
Nov 14 02:12:31 user nova-compute[75257]:     </interface>
Nov 14 02:12:31 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:12:31 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/console.log" append="off"/>
Nov 14 02:12:31 user nova-compute[75257]:     </serial>
Nov 14 02:12:31 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:12:31 user nova-compute[75257]:     <video>
Nov 14 02:12:31 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:12:31 user nova-compute[75257]:     </video>
Nov 14 02:12:31 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:12:31 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:12:31 user nova-compute[75257]:     </rng>
Nov 14 02:12:31 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:12:31 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:12:31 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:12:31 user nova-compute[75257]:     </memballoon>
Nov 14 02:12:31 user nova-compute[75257]:   </devices>
Nov 14 02:12:31 user nova-compute[75257]: </domain>
Nov 14 02:12:31 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-439193571',display_name='tempest-ServerRescueNegativeTestJSON-server-439193571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-439193571',id=20,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-c10r056v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:12:30Z,user_data=None,user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=aef5782b-9a73-4309-a559-4a81d3c5ce2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=38baa7d3-e79c-48c0-a478-d946f09f9787,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38baa7d3-e7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG os_vif [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=38baa7d3-e79c-48c0-a478-d946f09f9787,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38baa7d3-e7') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dce89ef1-454c-5343-8dad-575835489549', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38baa7d3-e7, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38baa7d3-e7, col_values=(('qos', UUID('48a0fb12-a3ac-4f0d-b624-edc55b69f2d2')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38baa7d3-e7, col_values=(('external_ids', {'iface-id': '38baa7d3-e79c-48c0-a478-d946f09f9787', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:bd:de', 'vm-uuid': 'aef5782b-9a73-4309-a559-4a81d3c5ce2e'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:31 user nova-compute[75257]: INFO os_vif [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=38baa7d3-e79c-48c0-a478-d946f09f9787,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38baa7d3-e7')
Nov 14 02:12:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No VIF found with MAC fa:16:3e:68:bd:de, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.neutron [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updated VIF entry in instance network info cache for port 38baa7d3-e79c-48c0-a478-d946f09f9787. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG nova.network.neutron [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updating instance_info_cache with network_info: [{"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:12:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4adc66f8-5ee8-4320-b3fb-3f8bf9b775ea req-bd8995d1-11c1-4628-9c5c-1c0e02b562b4 service nova] Releasing lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:12:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:12:34 user nova-compute[75257]: WARNING nova.compute.manager [req-654f9fa3-e464-4e5a-92bb-99c18d88670d req-7f24b9de-4df0-41e2-8624-b7c8211fbceb service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state building and task_state spawning.
Nov 14 02:12:34 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 is timed out.
Nov 14 02:12:34 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Successfully detached device vdb from instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 from the live domain config.
Nov 14 02:12:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLfdnmiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:34 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[46624a7a-d9ab-47d7-a95a-996a7f1ce8b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:12:34 user nova-compute[75257]: No targets found.
Nov 14 02:12:34 user nova-compute[75257]: iSNS:
Nov 14 02:12:34 user nova-compute[75257]: No targets found.
Nov 14 02:12:34 user nova-compute[75257]: STATIC:
Nov 14 02:12:34 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a
Nov 14 02:12:34 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:34 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:34 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673
Nov 14 02:12:34 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:34 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:34 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:12:34 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:34 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:34 user nova-compute[75257]: FIRMWARE:
Nov 14 02:12:34 user nova-compute[75257]: No targets found.
Nov 14 02:12:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:12:34 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:12:34 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7051115f-9b45-40be-b02c-a31a0197cf00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9a5fbb-904b-4250-a222-c0bcab3c6758]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:34 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:34 user nova-compute[75257]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a (non-flash)
Nov 14 02:12:34 user nova-compute[75257]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:34 user nova-compute[75257]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c119630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a'): ({'sdg'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Removing single pathed devices sdg {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa95c4df-4e99-4460-b3ce-2392287f4623]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b3dd79-2278-468b-841d-877d2a16e6a1]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Flushing IO for device /dev/sdg {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af59d2e1-5e70-49c0-abe3-d6263321e613]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[513a092f-39de-4a8b-b6bb-a626a42a8575]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] SCSI volumes sdg have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[34099510-602c-4e76-a30f-f188117fbe1a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e140115-2e43-42dc-bd22-21db042e214f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a, portal: 172.16.0.220,3260]
Nov 14 02:12:34 user nova-compute[75257]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a, portal: 172.16.0.220,3260] successful.
Nov 14 02:12:34 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26d0df-3e86-4e5e-bd0d-5deae5534d5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a8c4a3-52aa-4225-9cb7-355808ab3e0a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] <== disconnect_volume: return (297ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.objects.instance [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'flavor' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-19aa4e1b-2511-478d-bf69-e037b20d764b tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.623s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:12:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Instance spawned successfully.
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:12:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Instance spawned successfully.
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:12:35 user nova-compute[75257]: INFO nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:12:35 user nova-compute[75257]: INFO nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 14 02:12:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:12:35 user nova-compute[75257]: INFO nova.compute.manager [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Took 7.28 seconds to build instance.
Nov 14 02:12:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e0fbcb8-02ca-4b3f-9b58-11c95f9be775 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.435s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:35 user nova-compute[75257]: INFO nova.compute.manager [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Took 6.62 seconds to build instance.
Nov 14 02:12:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-66903ecd-637a-4dcd-a26f-6539839cec9a tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.726s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:12:36 user nova-compute[75257]: WARNING nova.compute.manager [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state active and task_state None.
Nov 14 02:12:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] No waiting events found dispatching network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:12:36 user nova-compute[75257]: WARNING nova.compute.manager [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received unexpected event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 for instance with vm_state active and task_state None.
Nov 14 02:12:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] No waiting events found dispatching network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:12:36 user nova-compute[75257]: WARNING nova.compute.manager [req-90bd12e2-6a1c-4479-8be5-f25f80d860d3 req-efcda136-2007-4878-9944-2b39061bfe3d service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received unexpected event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 for instance with vm_state active and task_state None.
Nov 14 02:12:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:49 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d89aad70-7a33-4519-8308-f9ed98031692 is timed out.
Nov 14 02:12:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Successfully detached device vdb from instance d89aad70-7a33-4519-8308-f9ed98031692 from the live domain config.
Nov 14 02:12:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mLSeWiDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '5dc69db0-7870-47f5-893c-3a671a567673'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:12:49 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bba8b8-a517-4802-8667-1c774ed21ffd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:12:49 user nova-compute[75257]: No targets found.
Nov 14 02:12:49 user nova-compute[75257]: iSNS:
Nov 14 02:12:49 user nova-compute[75257]: No targets found.
Nov 14 02:12:49 user nova-compute[75257]: STATIC:
Nov 14 02:12:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673
Nov 14 02:12:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:12:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:12:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:12:49 user nova-compute[75257]: FIRMWARE:
Nov 14 02:12:49 user nova-compute[75257]: No targets found.
Nov 14 02:12:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:12:49 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:12:49 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4908e103-04d5-4466-a4de-f2cdbec1b099]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5743e674-a939-4824-90b2-85874f52e21f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:49 user nova-compute[75257]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:12:49 user nova-compute[75257]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 (non-flash)
Nov 14 02:12:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c429000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.055s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7499f76-92f5-4b99-b9e5-cff2c0ba7e4b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d388911b-1b48-4de2-bb3b-7aaba5d2bdea]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9118ef2-ef38-47ce-92ec-d31ed1e5d32a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.120s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b3572f-14fe-41f0-87de-b088ec4034a6]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e4c490-01d3-40aa-8aa4-036eee7690ff]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[494a1c76-f413-469b-9a90-c181c7b4c2e7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260]
Nov 14 02:12:49 user nova-compute[75257]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673, portal: 172.16.0.220,3260] successful.
Nov 14 02:12:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dc69db0-7870-47f5-893c-3a671a567673 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c99288f-0fd6-4ae5-a14a-7116dff1cdf8]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.474s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] <== disconnect_volume: return (476ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:12:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:12:50 user nova-compute[75257]: DEBUG nova.objects.instance [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lazy-loading 'flavor' on Instance uuid d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:12:50 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:12:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-644bc909-5422-4982-b637-d87cbcd2eef6 tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.873s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:51 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:12:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:53 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:12:53 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:12:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:12:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:12:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:12:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:12:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:12:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:12:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:12:59 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:12:59 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=25.233989715576172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 71a9d20f-e79b-4716-abf8-a15330742167 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2f9df98c-7814-419d-8821-d8c571972f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance d89aad70-7a33-4519-8308-f9ed98031692 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:12:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:13:00 user nova-compute[75257]: INFO nova.compute.claims [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Claim successful on node user
Nov 14 02:13:00 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Skipping network cache update for instance because it is Building. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:13:01 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.policy [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:13:01 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Creating image(s)
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "/opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "/opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updating instance_info_cache with network_info: [{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.220s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk 1073741824" returned: 0 in 0.056s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Successfully created port: ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Cannot resize image /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Ensure instance console log exists: /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Successfully updated port: ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-changed-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Refreshing instance network info cache due to event network-changed-ed73d0a9-0d24-470f-9fef-56c5474f0a9e. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] Acquiring lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] Acquired lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Refreshing network info cache for port ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:13:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1faf000f-ab69-42b5-a82d-a6fba673fb57 req-99ed2078-3ad0-4dc9-9e10-0b4fa55db4d9 service nova] Releasing lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquired lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating instance_info_cache with network_info: [{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Releasing lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance network_info: |[{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Start _get_guest_xml network_info=[{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:13:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-164252655',display_name='tempest-ServerActionsTestOtherB-server-164252655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-164252655',id=21,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA==',key_name='tempest-keypair-1362037621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dcd87f632574f81813bc7606a8fe70e',ramdisk_id='',reservation_id='r-5x0q0qiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2069029360',owner_user_name='tempest-ServerActionsTestOtherB-2069029360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73fe859f2604a1bbf70f01587cf015c',uuid=ce3a9680-3062-4e7d-8af3-81c31f3f499c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converting VIF {"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lazy-loading 'pci_devices' on Instance uuid ce3a9680-3062-4e7d-8af3-81c31f3f499c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:13:03 user nova-compute[75257]:   <uuid>ce3a9680-3062-4e7d-8af3-81c31f3f499c</uuid>
Nov 14 02:13:03 user nova-compute[75257]:   <name>instance-00000015</name>
Nov 14 02:13:03 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:13:03 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:13:03 user nova-compute[75257]:   <metadata>
Nov 14 02:13:03 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:13:03 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:13:03 user nova-compute[75257]:       <nova:name>tempest-ServerActionsTestOtherB-server-164252655</nova:name>
Nov 14 02:13:03 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:13:03</nova:creationTime>
Nov 14 02:13:03 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:13:03 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:13:03 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:13:03 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:13:03 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:13:03 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:13:03 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:13:03 user nova-compute[75257]:       <nova:owner>
Nov 14 02:13:03 user nova-compute[75257]:         <nova:user uuid="b73fe859f2604a1bbf70f01587cf015c">tempest-ServerActionsTestOtherB-2069029360-project-member</nova:user>
Nov 14 02:13:03 user nova-compute[75257]:         <nova:project uuid="5dcd87f632574f81813bc7606a8fe70e">tempest-ServerActionsTestOtherB-2069029360</nova:project>
Nov 14 02:13:03 user nova-compute[75257]:       </nova:owner>
Nov 14 02:13:03 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:13:03 user nova-compute[75257]:       <nova:ports>
Nov 14 02:13:03 user nova-compute[75257]:         <nova:port uuid="ed73d0a9-0d24-470f-9fef-56c5474f0a9e">
Nov 14 02:13:03 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 02:13:03 user nova-compute[75257]:         </nova:port>
Nov 14 02:13:03 user nova-compute[75257]:       </nova:ports>
Nov 14 02:13:03 user nova-compute[75257]:     </nova:instance>
Nov 14 02:13:03 user nova-compute[75257]:   </metadata>
Nov 14 02:13:03 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:13:03 user nova-compute[75257]:     <system>
Nov 14 02:13:03 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:13:03 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:13:03 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:13:03 user nova-compute[75257]:       <entry name="serial">ce3a9680-3062-4e7d-8af3-81c31f3f499c</entry>
Nov 14 02:13:03 user nova-compute[75257]:       <entry name="uuid">ce3a9680-3062-4e7d-8af3-81c31f3f499c</entry>
Nov 14 02:13:03 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:13:03 user nova-compute[75257]:     </system>
Nov 14 02:13:03 user nova-compute[75257]:   </sysinfo>
Nov 14 02:13:03 user nova-compute[75257]:   <os>
Nov 14 02:13:03 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:13:03 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:13:03 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:13:03 user nova-compute[75257]:   </os>
Nov 14 02:13:03 user nova-compute[75257]:   <features>
Nov 14 02:13:03 user nova-compute[75257]:     <acpi/>
Nov 14 02:13:03 user nova-compute[75257]:     <apic/>
Nov 14 02:13:03 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:13:03 user nova-compute[75257]:   </features>
Nov 14 02:13:03 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:13:03 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:13:03 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:13:03 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:13:03 user nova-compute[75257]:   </clock>
Nov 14 02:13:03 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:13:03 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:13:03 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:13:03 user nova-compute[75257]:   </cpu>
Nov 14 02:13:03 user nova-compute[75257]:   <devices>
Nov 14 02:13:03 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:13:03 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:13:03 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk"/>
Nov 14 02:13:03 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:13:03 user nova-compute[75257]:     </disk>
Nov 14 02:13:03 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:13:03 user nova-compute[75257]:       <mac address="fa:16:3e:40:6e:3c"/>
Nov 14 02:13:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:13:03 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:13:03 user nova-compute[75257]:       <target dev="taped73d0a9-0d"/>
Nov 14 02:13:03 user nova-compute[75257]:     </interface>
Nov 14 02:13:03 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:13:03 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/console.log" append="off"/>
Nov 14 02:13:03 user nova-compute[75257]:     </serial>
Nov 14 02:13:03 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:13:03 user nova-compute[75257]:     <video>
Nov 14 02:13:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:13:03 user nova-compute[75257]:     </video>
Nov 14 02:13:03 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:13:03 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:13:03 user nova-compute[75257]:     </rng>
Nov 14 02:13:03 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:13:03 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:13:03 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:13:03 user nova-compute[75257]:     </memballoon>
Nov 14 02:13:03 user nova-compute[75257]:   </devices>
Nov 14 02:13:03 user nova-compute[75257]: </domain>
Nov 14 02:13:03 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-164252655',display_name='tempest-ServerActionsTestOtherB-server-164252655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-164252655',id=21,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA==',key_name='tempest-keypair-1362037621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dcd87f632574f81813bc7606a8fe70e',ramdisk_id='',reservation_id='r-5x0q0qiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2069029360',owner_user_name='tempest-ServerActionsTestOtherB-2069029360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:13:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73fe859f2604a1bbf70f01587cf015c',uuid=ce3a9680-3062-4e7d-8af3-81c31f3f499c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converting VIF {"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG os_vif [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7017007e-89e8-5e44-9605-e311f7edbe68', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped73d0a9-0d, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped73d0a9-0d, col_values=(('qos', UUID('c2a36b57-c94e-49fa-b985-e2643cfee451')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped73d0a9-0d, col_values=(('external_ids', {'iface-id': 'ed73d0a9-0d24-470f-9fef-56c5474f0a9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:6e:3c', 'vm-uuid': 'ce3a9680-3062-4e7d-8af3-81c31f3f499c'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:03 user nova-compute[75257]: INFO os_vif [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d')
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:13:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] No VIF found with MAC fa:16:3e:40:6e:3c, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:04 user nova-compute[75257]: INFO nova.compute.manager [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Terminating instance
Nov 14 02:13:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-unplugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-unplugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-5d162f16-7e13-4ad5-b95a-d808f00840ec req-df980151-3144-43c6-a9ab-593df6975b66 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-unplugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:13:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:13:05 user nova-compute[75257]: INFO nova.compute.claims [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Claim successful on node user
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Instance destroyed successfully.
Nov 14 02:13:05 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lazy-loading 'resources' on Instance uuid b9b5a6d0-1304-49c1-90fb-5964d56885c8 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1579375628',display_name='tempest-ServerStableDeviceRescueTest-server-1579375628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1579375628',id=4,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq7oRF6OXXfz/US7S5M/p/e15didQje182FxTBE9gXxDXx7o0EBCTENzobqIRSryWT181xbmOLIIMJAJVc0DG69fsUd13H6dI+0Clcf6sFNLQBtvOE6JrQMPFfhuLmNrg==',key_name='tempest-keypair-1863826463',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:09:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c82a8c1198544448e57221af68aa01e',ramdisk_id='',reservation_id='r-b9n4kmvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2053742251',owner_user_name='tempest-ServerStableDeviceRescueTest-2053742251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='684b5b76244349489205840fb9b4e39d',uuid=b9b5a6d0-1304-49c1-90fb-5964d56885c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Converting VIF {"id": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "address": "fa:16:3e:88:71:d6", "network": {"id": "5919d81b-1969-4559-82b3-6497f0571caa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1252226709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c82a8c1198544448e57221af68aa01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe0bc37-94", "ovs_interfaceid": "8fe0bc37-945a-433d-8dd0-43514dce6f99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:71:d6,bridge_name='br-int',has_traffic_filtering=True,id=8fe0bc37-945a-433d-8dd0-43514dce6f99,network=Network(5919d81b-1969-4559-82b3-6497f0571caa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe0bc37-94') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG os_vif [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:71:d6,bridge_name='br-int',has_traffic_filtering=True,id=8fe0bc37-945a-433d-8dd0-43514dce6f99,network=Network(5919d81b-1969-4559-82b3-6497f0571caa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe0bc37-94') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fe0bc37-94, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c41c77f6-ba71-416e-9202-228b05a39e6e) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: INFO os_vif [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:71:d6,bridge_name='br-int',has_traffic_filtering=True,id=8fe0bc37-945a-433d-8dd0-43514dce6f99,network=Network(5919d81b-1969-4559-82b3-6497f0571caa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe0bc37-94')
Nov 14 02:13:05 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Deleting instance files /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8_del
Nov 14 02:13:05 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Deletion of /opt/stack/data/nova/instances/b9b5a6d0-1304-49c1-90fb-5964d56885c8_del complete
Nov 14 02:13:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:05 user nova-compute[75257]: INFO nova.compute.manager [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 14 02:13:05 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:13:05 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:13:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.policy [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:13:06 user nova-compute[75257]: INFO nova.compute.manager [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] instance snapshotting
Nov 14 02:13:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Beginning live snapshot process
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:13:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Creating image(s)
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "/opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "/opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "/opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.208s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-deleted-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:06 user nova-compute[75257]: INFO nova.compute.manager [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Neutron deleted interface 8fe0bc37-945a-433d-8dd0-43514dce6f99; detaching it from the instance and deleting it from the info cache
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json -f qcow2 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:06 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Took 0.84 seconds to deallocate network for instance.
Nov 14 02:13:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-3dd5c1b6-f225-42e4-9151-4ca72e533ee1 req-d48e8edd-2f14-4a83-9038-2b52584c95f5 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Detach interface failed, port_id=8fe0bc37-945a-433d-8dd0-43514dce6f99, reason: Instance b9b5a6d0-1304-49c1-90fb-5964d56885c8 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk 1073741824" returned: 0 in 0.065s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json -f qcow2" returned: 0 in 0.261s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json -f qcow2 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] Acquiring lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] No waiting events found dispatching network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:07 user nova-compute[75257]: WARNING nova.compute.manager [req-87cea697-3dc5-4cb5-9f13-baa2d23d9797 req-65bd9dd5-5657-4584-ac40-1e259f70c671 service nova] [instance: b9b5a6d0-1304-49c1-90fb-5964d56885c8] Received unexpected event network-vif-plugged-8fe0bc37-945a-433d-8dd0-43514dce6f99 for instance with vm_state deleted and task_state None.
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Successfully created port: 4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json -f qcow2" returned: 0 in 0.234s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Cannot resize image /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Ensure instance console log exists: /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ruingdf/92cf38e9d7b2489da85f444c49b32b08.delta 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ruingdf/92cf38e9d7b2489da85f444c49b32b08.delta 1073741824" returned: 0 in 0.059s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:07 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:07 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Deleted allocations for instance b9b5a6d0-1304-49c1-90fb-5964d56885c8
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:13:07 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance spawned successfully.
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Successfully updated port: 4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1f94eb4e-1d31-41b6-ad42-704757185eb1 tempest-ServerStableDeviceRescueTest-2053742251 tempest-ServerStableDeviceRescueTest-2053742251-project-member] Lock "b9b5a6d0-1304-49c1-90fb-5964d56885c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquired lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:13:07 user nova-compute[75257]: INFO nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Took 6.54 seconds to spawn the instance on the hypervisor.
Nov 14 02:13:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:13:07 user nova-compute[75257]: INFO nova.compute.manager [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Took 7.44 seconds to build instance.
Nov 14 02:13:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b117e2ce-50d2-485b-ae09-51a38af9281b tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.571s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Updating instance_info_cache with network_info: [{"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Releasing lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Instance network_info: |[{"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Start _get_guest_xml network_info=[{"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:13:08 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:08 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-887301658',display_name='tempest-TestStampPattern-server-887301658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-887301658',id=22,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA29cl1fr1mQddCmz0NjRlHZtGI31Z/HpB+Nsx3OGKzEmi6USs0zIOlWO+VML9vORCyVCO+2Wn/r9l3Z21RvN0BLUGIBRfBmYCbzP7P30tWvVkVZygqVIesWMX0qe0GeCw==',key_name='tempest-TestStampPattern-863039138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbfae642569847a2a3ac4cd4066aeb22',ramdisk_id='',reservation_id='r-j3q7vgjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1994748770',owner_user_name='tempest-TestStampPattern-1994748770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:13:06Z,user_data=None,user_id='089b000c028b46b998f2c128a6cf3d0a',uuid=c226a1bf-4b89-49e0-ad8f-149849f12639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converting VIF {"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:61:93,bridge_name='br-int',has_traffic_filtering=True,id=4f86002d-ead3-4d58-be50-4e1d2c09896a,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f86002d-ea') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'pci_devices' on Instance uuid c226a1bf-4b89-49e0-ad8f-149849f12639 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:13:08 user nova-compute[75257]:   <uuid>c226a1bf-4b89-49e0-ad8f-149849f12639</uuid>
Nov 14 02:13:08 user nova-compute[75257]:   <name>instance-00000016</name>
Nov 14 02:13:08 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:13:08 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:13:08 user nova-compute[75257]:   <metadata>
Nov 14 02:13:08 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:13:08 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:13:08 user nova-compute[75257]:       <nova:name>tempest-TestStampPattern-server-887301658</nova:name>
Nov 14 02:13:08 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:13:08</nova:creationTime>
Nov 14 02:13:08 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:13:08 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:13:08 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:13:08 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:13:08 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:13:08 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:13:08 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:13:08 user nova-compute[75257]:       <nova:owner>
Nov 14 02:13:08 user nova-compute[75257]:         <nova:user uuid="089b000c028b46b998f2c128a6cf3d0a">tempest-TestStampPattern-1994748770-project-member</nova:user>
Nov 14 02:13:08 user nova-compute[75257]:         <nova:project uuid="fbfae642569847a2a3ac4cd4066aeb22">tempest-TestStampPattern-1994748770</nova:project>
Nov 14 02:13:08 user nova-compute[75257]:       </nova:owner>
Nov 14 02:13:08 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:13:08 user nova-compute[75257]:       <nova:ports>
Nov 14 02:13:08 user nova-compute[75257]:         <nova:port uuid="4f86002d-ead3-4d58-be50-4e1d2c09896a">
Nov 14 02:13:08 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 02:13:08 user nova-compute[75257]:         </nova:port>
Nov 14 02:13:08 user nova-compute[75257]:       </nova:ports>
Nov 14 02:13:08 user nova-compute[75257]:     </nova:instance>
Nov 14 02:13:08 user nova-compute[75257]:   </metadata>
Nov 14 02:13:08 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:13:08 user nova-compute[75257]:     <system>
Nov 14 02:13:08 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:13:08 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:13:08 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:13:08 user nova-compute[75257]:       <entry name="serial">c226a1bf-4b89-49e0-ad8f-149849f12639</entry>
Nov 14 02:13:08 user nova-compute[75257]:       <entry name="uuid">c226a1bf-4b89-49e0-ad8f-149849f12639</entry>
Nov 14 02:13:08 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:13:08 user nova-compute[75257]:     </system>
Nov 14 02:13:08 user nova-compute[75257]:   </sysinfo>
Nov 14 02:13:08 user nova-compute[75257]:   <os>
Nov 14 02:13:08 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:13:08 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:13:08 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:13:08 user nova-compute[75257]:   </os>
Nov 14 02:13:08 user nova-compute[75257]:   <features>
Nov 14 02:13:08 user nova-compute[75257]:     <acpi/>
Nov 14 02:13:08 user nova-compute[75257]:     <apic/>
Nov 14 02:13:08 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:13:08 user nova-compute[75257]:   </features>
Nov 14 02:13:08 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:13:08 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:13:08 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:13:08 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:13:08 user nova-compute[75257]:   </clock>
Nov 14 02:13:08 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:13:08 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:13:08 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:13:08 user nova-compute[75257]:   </cpu>
Nov 14 02:13:08 user nova-compute[75257]:   <devices>
Nov 14 02:13:08 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:13:08 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:13:08 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk"/>
Nov 14 02:13:08 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:13:08 user nova-compute[75257]:     </disk>
Nov 14 02:13:08 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:13:08 user nova-compute[75257]:       <mac address="fa:16:3e:39:61:93"/>
Nov 14 02:13:08 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:13:08 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:13:08 user nova-compute[75257]:       <target dev="tap4f86002d-ea"/>
Nov 14 02:13:08 user nova-compute[75257]:     </interface>
Nov 14 02:13:08 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:13:08 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/console.log" append="off"/>
Nov 14 02:13:08 user nova-compute[75257]:     </serial>
Nov 14 02:13:08 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:13:08 user nova-compute[75257]:     <video>
Nov 14 02:13:08 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:13:08 user nova-compute[75257]:     </video>
Nov 14 02:13:08 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:13:08 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:13:08 user nova-compute[75257]:     </rng>
Nov 14 02:13:08 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:13:08 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:13:08 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:13:08 user nova-compute[75257]:     </memballoon>
Nov 14 02:13:08 user nova-compute[75257]:   </devices>
Nov 14 02:13:08 user nova-compute[75257]: </domain>
Nov 14 02:13:08 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-887301658',display_name='tempest-TestStampPattern-server-887301658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-887301658',id=22,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA29cl1fr1mQddCmz0NjRlHZtGI31Z/HpB+Nsx3OGKzEmi6USs0zIOlWO+VML9vORCyVCO+2Wn/r9l3Z21RvN0BLUGIBRfBmYCbzP7P30tWvVkVZygqVIesWMX0qe0GeCw==',key_name='tempest-TestStampPattern-863039138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbfae642569847a2a3ac4cd4066aeb22',ramdisk_id='',reservation_id='r-j3q7vgjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1994748770',owner_user_name='tempest-TestStampPattern-1994748770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:13:06Z,user_data=None,user_id='089b000c028b46b998f2c128a6cf3d0a',uuid=c226a1bf-4b89-49e0-ad8f-149849f12639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converting VIF {"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:61:93,bridge_name='br-int',has_traffic_filtering=True,id=4f86002d-ead3-4d58-be50-4e1d2c09896a,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f86002d-ea') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG os_vif [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:61:93,bridge_name='br-int',has_traffic_filtering=True,id=4f86002d-ead3-4d58-be50-4e1d2c09896a,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f86002d-ea') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef91964c-600a-53e7-9546-d23abd6ef94c', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f86002d-ea, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f86002d-ea, col_values=(('qos', UUID('b1c36ea6-f2ea-4d76-804a-f21b40611c2a')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f86002d-ea, col_values=(('external_ids', {'iface-id': '4f86002d-ead3-4d58-be50-4e1d2c09896a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:61:93', 'vm-uuid': 'c226a1bf-4b89-49e0-ad8f-149849f12639'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:08 user nova-compute[75257]: INFO os_vif [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:61:93,bridge_name='br-int',has_traffic_filtering=True,id=4f86002d-ead3-4d58-be50-4e1d2c09896a,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f86002d-ea')
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] COPY block job progress, current cursor: 262144 final cursor: 75497472 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No VIF found with MAC fa:16:3e:39:61:93, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] COPY block job progress, current cursor: 14090240 final cursor: 75497472 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:08 user nova-compute[75257]: WARNING nova.compute.manager [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state active and task_state None.
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:08 user nova-compute[75257]: WARNING nova.compute.manager [req-ee78a618-c156-4a49-806f-126a11cb6df8 req-d3749ea9-c26e-4b52-8665-66ed03e804ed service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state active and task_state None.
Nov 14 02:13:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received event network-changed-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Refreshing instance network info cache due to event network-changed-4f86002d-ead3-4d58-be50-4e1d2c09896a. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] Acquiring lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] Acquired lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Refreshing network info cache for port 4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:13:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 02:13:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Updated VIF entry in instance network info cache for port 4f86002d-ead3-4d58-be50-4e1d2c09896a. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Updating instance_info_cache with network_info: [{"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-de195a78-4617-4747-84b3-2366955740cc req-0ea75947-7f05-43cd-b0fe-72adc71e0469 service nova] Releasing lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ruingdf/92cf38e9d7b2489da85f444c49b32b08.delta /opt/stack/data/nova/instances/snapshots/tmp_ruingdf/92cf38e9d7b2489da85f444c49b32b08 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received event network-vif-plugged-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] No waiting events found dispatching network-vif-plugged-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:09 user nova-compute[75257]: WARNING nova.compute.manager [req-18e5c636-3926-4bd7-870f-b9e2b0ae94b4 req-a6ed6396-77d8-4617-bd36-b02b19970156 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received unexpected event network-vif-plugged-4f86002d-ead3-4d58-be50-4e1d2c09896a for instance with vm_state building and task_state spawning.
Nov 14 02:13:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ruingdf/92cf38e9d7b2489da85f444c49b32b08.delta /opt/stack/data/nova/instances/snapshots/tmp_ruingdf/92cf38e9d7b2489da85f444c49b32b08" returned: 0 in 0.695s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:10 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Snapshot extracted, beginning image upload
Nov 14 02:13:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received event network-vif-plugged-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] No waiting events found dispatching network-vif-plugged-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:12 user nova-compute[75257]: WARNING nova.compute.manager [req-93d0d1e3-fd85-4e80-ae0f-fd64ac8f7574 req-176aeea2-bc12-45e2-8f44-6c1a423c0805 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received unexpected event network-vif-plugged-4f86002d-ead3-4d58-be50-4e1d2c09896a for instance with vm_state building and task_state spawning.
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:13:12 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Instance spawned successfully.
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:13:12 user nova-compute[75257]: INFO nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 14 02:13:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:13:12 user nova-compute[75257]: INFO nova.compute.manager [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Took 6.94 seconds to build instance.
Nov 14 02:13:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2687cc18-7f6d-4fff-8791-14c6209f596f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.072s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:13 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Snapshot image upload complete
Nov 14 02:13:13 user nova-compute[75257]: INFO nova.compute.manager [None req-149f6e5e-ba8d-4068-9192-051a1230f590 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Took 6.66 seconds to snapshot the instance on the hypervisor.
Nov 14 02:13:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:19 user nova-compute[75257]: INFO nova.compute.manager [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Terminating instance
Nov 14 02:13:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received event network-vif-unplugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] No waiting events found dispatching network-vif-unplugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-c7f310b1-14bf-44e6-b62e-f21dd48f57f1 req-b79226f1-ed77-40c1-ba24-7f50e90bbee6 service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received event network-vif-unplugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:13:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Instance destroyed successfully.
Nov 14 02:13:19 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lazy-loading 'resources' on Instance uuid d89aad70-7a33-4519-8308-f9ed98031692 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-405678036',display_name='tempest-TestVolumeSwap-server-405678036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-405678036',id=16,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7RzV/4Ypkr9Ux4gBjv/6XnOLctGJvPbC68tHH5zEAYEzzHjvU9DI9lPLMmf+YRNz+/cZcpYDl9EEuPGW0KMFdut0kCse1RyMksPvsUw7Fgv3s1R4iIdE2/n+CMGHHu3g==',key_name='tempest-keypair-343931820',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:10:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94ac0058ef794b9b860bf77eec4e6ac0',ramdisk_id='',reservation_id='r-vt4o6dh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-3367491',owner_user_name='tempest-TestVolumeSwap-3367491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='817e73cf3aab4227baee2a818261aa41',uuid=d89aad70-7a33-4519-8308-f9ed98031692,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Converting VIF {"id": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "address": "fa:16:3e:60:d3:97", "network": {"id": "a1a582cc-802d-4caa-b01e-3ee12453e79a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-181968981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94ac0058ef794b9b860bf77eec4e6ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c8ac591-92", "ovs_interfaceid": "4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:d3:97,bridge_name='br-int',has_traffic_filtering=True,id=4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084,network=Network(a1a582cc-802d-4caa-b01e-3ee12453e79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8ac591-92') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG os_vif [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:d3:97,bridge_name='br-int',has_traffic_filtering=True,id=4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084,network=Network(a1a582cc-802d-4caa-b01e-3ee12453e79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8ac591-92') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c8ac591-92, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e21af307-0be0-4af1-9648-65f7c4f7e357) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:19 user nova-compute[75257]: INFO os_vif [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:d3:97,bridge_name='br-int',has_traffic_filtering=True,id=4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084,network=Network(a1a582cc-802d-4caa-b01e-3ee12453e79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c8ac591-92')
Nov 14 02:13:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Deleting instance files /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692_del
Nov 14 02:13:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Deletion of /opt/stack/data/nova/instances/d89aad70-7a33-4519-8308-f9ed98031692_del complete
Nov 14 02:13:20 user nova-compute[75257]: INFO nova.compute.manager [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 02:13:20 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:13:20 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:13:20 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: d89aad70-7a33-4519-8308-f9ed98031692] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:13:20 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:21 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Took 0.96 seconds to deallocate network for instance.
Nov 14 02:13:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received event network-vif-plugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] Acquiring lock "d89aad70-7a33-4519-8308-f9ed98031692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] Lock "d89aad70-7a33-4519-8308-f9ed98031692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] No waiting events found dispatching network-vif-plugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:21 user nova-compute[75257]: WARNING nova.compute.manager [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received unexpected event network-vif-plugged-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 for instance with vm_state deleted and task_state None.
Nov 14 02:13:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-4510c021-6b08-4e2b-b67a-27123994c2b6 req-725b9346-12c7-47a1-b34c-d180aa2e81ec service nova] [instance: d89aad70-7a33-4519-8308-f9ed98031692] Received event network-vif-deleted-4c8ac591-92cb-4fc3-98d0-bb4b6a8bd084 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:21 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:13:21 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:13:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.545s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:21 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Deleted allocations for instance d89aad70-7a33-4519-8308-f9ed98031692
Nov 14 02:13:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f7efe93b-2f6b-4766-b019-7d50cb2b47ce tempest-TestVolumeSwap-3367491 tempest-TestVolumeSwap-3367491-project-member] Lock "d89aad70-7a33-4519-8308-f9ed98031692" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.626s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'flavor' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:27 user nova-compute[75257]: INFO nova.compute.manager [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Attaching volume 8ae6554c-749e-436f-b233-36c7d3784082 to /dev/vdb
Nov 14 02:13:27 user nova-compute[75257]: DEBUG os_brick.utils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfd4429-4022-4150-b873-32a8150467ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b17c401-0468-4dcb-baf7-36237cb2ea65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc55418-be59-414c-b96b-32c67ff841b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee83a53f-5ad8-41bc-ac24-a9f914a24589]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:13:27 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:13:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fae1e2-f7eb-4f95-b0b6-e045f9c40a88]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG os_brick.utils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:13:27 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updating existing volume attachment record: 7ea0f1ee-7c8e-4c27-bd1c-b1ac91b79df7 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:13:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECTNMDQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:13:31 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:13:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:13:31 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:13:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:13:31 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:13:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc160d5c-b0f5-4cdb-8840-4f98f511f920]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:13:31 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e94dd9-54f5-49f9-804b-8f3efe4ddb9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082] added
Nov 14 02:13:31 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e5615-6238-4392-ad59-b5e6acc54284]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2650dc-9444-4f05-96a8-c44433c1aaa0]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECTNMDQf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECTNMDQf" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dc0a96-1406-40d7-a01c-b105df30c934]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECTNMDQf'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef3081e-488d-4d0d-8521-55a4cd09e5df]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a20be02-494f-4bca-b477-6d40cc6bae46]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c419b1-f7cc-4958-9388-ab29062f1da5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260]
Nov 14 02:13:32 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260] successful.
Nov 14 02:13:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[737a9779-e9e4-4d0b-b8f5-4c6d8ce9607b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f8f843-a23f-4e9b-893c-665f15bbb487]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:32 user nova-compute[75257]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:13:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:32 user nova-compute[75257]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:13:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a19bd-bb7b-4df3-adfb-3e262b06aa33]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECTNMDQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23936353033663235', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936353033663235', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'flavor' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:13:33 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:13:33 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:13:33 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:13:33 user nova-compute[75257]:   <serial>8ae6554c-749e-436f-b233-36c7d3784082</serial>
Nov 14 02:13:33 user nova-compute[75257]: </disk>
Nov 14 02:13:33 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No VIF found with MAC fa:16:3e:d9:88:d1, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:13:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d446cfac-5eed-4efd-83bc-458f6d54ed22 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.242s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-changed-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing instance network info cache due to event network-changed-de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:13:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] Acquiring lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:13:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] Acquired lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:13:37 user nova-compute[75257]: DEBUG nova.network.neutron [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing network info cache for port de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:13:38 user nova-compute[75257]: DEBUG nova.network.neutron [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updated VIF entry in instance network info cache for port de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:13:38 user nova-compute[75257]: DEBUG nova.network.neutron [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updating instance_info_cache with network_info: [{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2c6b6aac-4428-477e-96ed-d95aa77b2b41 req-95ae7238-e0ce-4937-984f-d7907e654947 service nova] Releasing lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:13:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-changed-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing instance network info cache due to event network-changed-de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:13:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] Acquiring lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:13:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] Acquired lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:13:39 user nova-compute[75257]: DEBUG nova.network.neutron [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing network info cache for port de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:13:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:40 user nova-compute[75257]: DEBUG nova.network.neutron [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updated VIF entry in instance network info cache for port de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:13:40 user nova-compute[75257]: DEBUG nova.network.neutron [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updating instance_info_cache with network_info: [{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0328fca1-2291-4752-a3de-c568457597a5 req-606da6a2-3dba-45db-aada-aa0effceabca service nova] Releasing lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:13:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:41 user nova-compute[75257]: INFO nova.compute.manager [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Rebooting instance
Nov 14 02:13:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:13:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquired lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:13:41 user nova-compute[75257]: DEBUG nova.network.neutron [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:13:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG nova.network.neutron [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updating instance_info_cache with network_info: [{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Releasing lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG nova.compute.manager [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-unplugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] No waiting events found dispatching network-vif-unplugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:42 user nova-compute[75257]: WARNING nova.compute.manager [req-deb42235-28c6-4f45-bca2-640730032745 req-26fcd08e-7ea0-4845-9892-12056be6bce3 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received unexpected event network-vif-unplugged-de607b68-f250-49c9-ac97-489a341f5963 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 02:13:42 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Instance destroyed successfully.
Nov 14 02:13:42 user nova-compute[75257]: DEBUG nova.objects.instance [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'resources' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550486898',display_name='tempest-TestMinimumBasicScenario-server-550486898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550486898',id=18,image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCerez3qRud3tNAAT12b+t4i+0H7Sr5njhlCmhyMPjU2JaLT1djZUoYL1W2kD0Bsh7apkcxxkNW/Nd2lfcp9UJBVsonfsZCS9Q4VFC2iCaV+Xa1MxoJDOhjo3xsuwm5kw==',key_name='tempest-TestMinimumBasicScenario-1349261540',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cfe231fae1941f4970c17e344df8b81',ramdisk_id='',reservation_id='r-p0leackj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1293674307',owner_user_name='tempest-TestMinimumBasicScenario-1293674307-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:13:42Z,user_data=None,user_id='87f69eeadbaf45bfa01dfdfa5efcccb3',uuid=2751bcd6-e958-4216-89f9-5e23f8b9dd9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converting VIF {"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG os_vif [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde607b68-f2, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=084bab18-f5de-4ef1-8aa5-ba9f01b753bf) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:43 user nova-compute[75257]: INFO os_vif [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2')
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECTNMDQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:13:43 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c222443-d853-4869-b57e-35567628028d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:13:43 user nova-compute[75257]: No targets found.
Nov 14 02:13:43 user nova-compute[75257]: iSNS:
Nov 14 02:13:43 user nova-compute[75257]: No targets found.
Nov 14 02:13:43 user nova-compute[75257]: STATIC:
Nov 14 02:13:43 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082
Nov 14 02:13:43 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:13:43 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:13:43 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:13:43 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:13:43 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:13:43 user nova-compute[75257]: FIRMWARE:
Nov 14 02:13:43 user nova-compute[75257]: No targets found.
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:13:43 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:13:43 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[761eae63-4656-4f65-8893-048b99ffc3a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b18f177-d35d-4618-b9ea-9a140d12a999]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c657760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fdbae8-381f-4663-97e6-72445f9b6be8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48be440-c6c6-4f9a-b26e-7398da27d3f7]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7518938-ff9f-4f11-b73e-d461cf8565b9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[efff0a12-5ea1-4002-91a8-59b78f8e9206]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[36efe21f-0f08-490a-a43d-90e37f42473b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6e5e22-079d-44d4-b136-d3e87a6304ae]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260]
Nov 14 02:13:43 user nova-compute[75257]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260] successful.
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b90bdef-44e1-4c20-bab8-f7b0998cbdac]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] <== disconnect_volume: return (292ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Start _get_guest_xml network_info=[{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7ea0f1ee-7c8e-4c27-bd1c-b1ac91b79df7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECTNMDQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '2751bcd6-e958-4216-89f9-5e23f8b9dd9b', 'attached_at': '', 'detached_at': '', 'volume_id': '8ae6554c-749e-436f-b233-36c7d3784082', 'serial': '8ae6554c-749e-436f-b233-36c7d3784082'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:13:43 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:43 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.objects.instance [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.objects.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Object Instance<2751bcd6-e958-4216-89f9-5e23f8b9dd9b> lazy-loaded attributes: resources,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECTNMDQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:13:43 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:13:43 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:13:43 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[968e2163-b9a8-4bcd-96d0-79580602c6fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:13:43 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5d7b5b-ae75-4bce-b0ee-52e6f1ee8e7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082] added
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db7b3d5-b298-43dd-bb76-7e758f482929]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ca815a-f6e1-4aec-ad0a-bb26491ab577]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECTNMDQf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECTNMDQf" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[677dc7d9-e193-4aeb-89b1-2f626020e927]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECTNMDQf'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[44753884-c50b-4d98-bb41-124ba3cbf28c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d41103-f677-4415-b63c-36e1ed4e5216]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[872b2a2c-b0ec-49fe-bca8-0e03ffb4063f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260]
Nov 14 02:13:43 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260] successful.
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae3843-80a3-4b32-94b0-a0cb9be8ba35]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffa2c21-d55a-45fd-9454-4b82462aac05]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:13:43 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efd2c63-c2e0-4dc3-823f-fcdea5e01c70]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:13:43 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECTNMDQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] No waiting events found dispatching network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:44 user nova-compute[75257]: WARNING nova.compute.manager [req-abbcb561-dc87-4f16-a8f7-3ab049e4fa4c req-c5bef023-3f47-4df7-90c9-a546845c51bf service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received unexpected event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 02:13:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23936353033663235', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936353033663235', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550486898',display_name='tempest-TestMinimumBasicScenario-server-550486898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550486898',id=18,image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCerez3qRud3tNAAT12b+t4i+0H7Sr5njhlCmhyMPjU2JaLT1djZUoYL1W2kD0Bsh7apkcxxkNW/Nd2lfcp9UJBVsonfsZCS9Q4VFC2iCaV+Xa1MxoJDOhjo3xsuwm5kw==',key_name='tempest-TestMinimumBasicScenario-1349261540',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cfe231fae1941f4970c17e344df8b81',ramdisk_id='',reservation_id='r-p0leackj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1293674307',owner_user_name='tempest-TestMinimumBasicScenario-1293674307-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:13:42Z,user_data=None,user_id='87f69eeadbaf45bfa01dfdfa5efcccb3',uuid=2751bcd6-e958-4216-89f9-5e23f8b9dd9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converting VIF {"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG nova.objects.instance [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'pci_devices' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG nova.objects.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Object Instance<2751bcd6-e958-4216-89f9-5e23f8b9dd9b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:13:44 user nova-compute[75257]:   <uuid>2751bcd6-e958-4216-89f9-5e23f8b9dd9b</uuid>
Nov 14 02:13:44 user nova-compute[75257]:   <name>instance-00000012</name>
Nov 14 02:13:44 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:13:44 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:13:44 user nova-compute[75257]:   <metadata>
Nov 14 02:13:44 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:13:44 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:13:44 user nova-compute[75257]:       <nova:name>tempest-TestMinimumBasicScenario-server-550486898</nova:name>
Nov 14 02:13:44 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:13:43</nova:creationTime>
Nov 14 02:13:44 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:13:44 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:13:44 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:13:44 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:13:44 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:13:44 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:13:44 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:13:44 user nova-compute[75257]:       <nova:owner>
Nov 14 02:13:44 user nova-compute[75257]:         <nova:user uuid="87f69eeadbaf45bfa01dfdfa5efcccb3">tempest-TestMinimumBasicScenario-1293674307-project-member</nova:user>
Nov 14 02:13:44 user nova-compute[75257]:         <nova:project uuid="9cfe231fae1941f4970c17e344df8b81">tempest-TestMinimumBasicScenario-1293674307</nova:project>
Nov 14 02:13:44 user nova-compute[75257]:       </nova:owner>
Nov 14 02:13:44 user nova-compute[75257]:       <nova:root type="image" uuid="3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7"/>
Nov 14 02:13:44 user nova-compute[75257]:       <nova:ports>
Nov 14 02:13:44 user nova-compute[75257]:         <nova:port uuid="de607b68-f250-49c9-ac97-489a341f5963">
Nov 14 02:13:44 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 02:13:44 user nova-compute[75257]:         </nova:port>
Nov 14 02:13:44 user nova-compute[75257]:       </nova:ports>
Nov 14 02:13:44 user nova-compute[75257]:     </nova:instance>
Nov 14 02:13:44 user nova-compute[75257]:   </metadata>
Nov 14 02:13:44 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:13:44 user nova-compute[75257]:     <system>
Nov 14 02:13:44 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:13:44 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:13:44 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:13:44 user nova-compute[75257]:       <entry name="serial">2751bcd6-e958-4216-89f9-5e23f8b9dd9b</entry>
Nov 14 02:13:44 user nova-compute[75257]:       <entry name="uuid">2751bcd6-e958-4216-89f9-5e23f8b9dd9b</entry>
Nov 14 02:13:44 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:13:44 user nova-compute[75257]:     </system>
Nov 14 02:13:44 user nova-compute[75257]:   </sysinfo>
Nov 14 02:13:44 user nova-compute[75257]:   <os>
Nov 14 02:13:44 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:13:44 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:13:44 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:13:44 user nova-compute[75257]:   </os>
Nov 14 02:13:44 user nova-compute[75257]:   <features>
Nov 14 02:13:44 user nova-compute[75257]:     <acpi/>
Nov 14 02:13:44 user nova-compute[75257]:     <apic/>
Nov 14 02:13:44 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:13:44 user nova-compute[75257]:   </features>
Nov 14 02:13:44 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:13:44 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:13:44 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:13:44 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:13:44 user nova-compute[75257]:   </clock>
Nov 14 02:13:44 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:13:44 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:13:44 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:13:44 user nova-compute[75257]:   </cpu>
Nov 14 02:13:44 user nova-compute[75257]:   <devices>
Nov 14 02:13:44 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:13:44 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:13:44 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk"/>
Nov 14 02:13:44 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:13:44 user nova-compute[75257]:     </disk>
Nov 14 02:13:44 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:13:44 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:13:44 user nova-compute[75257]:       <source dev="/dev/sdc"/>
Nov 14 02:13:44 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:13:44 user nova-compute[75257]:       <serial>8ae6554c-749e-436f-b233-36c7d3784082</serial>
Nov 14 02:13:44 user nova-compute[75257]:     </disk>
Nov 14 02:13:44 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:13:44 user nova-compute[75257]:       <mac address="fa:16:3e:d9:88:d1"/>
Nov 14 02:13:44 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:13:44 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:13:44 user nova-compute[75257]:       <target dev="tapde607b68-f2"/>
Nov 14 02:13:44 user nova-compute[75257]:     </interface>
Nov 14 02:13:44 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:13:44 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/console.log" append="off"/>
Nov 14 02:13:44 user nova-compute[75257]:     </serial>
Nov 14 02:13:44 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:13:44 user nova-compute[75257]:     <video>
Nov 14 02:13:44 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:13:44 user nova-compute[75257]:     </video>
Nov 14 02:13:44 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:13:44 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:13:44 user nova-compute[75257]:     </rng>
Nov 14 02:13:44 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:13:44 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:13:44 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:13:44 user nova-compute[75257]:     </memballoon>
Nov 14 02:13:44 user nova-compute[75257]:   </devices>
Nov 14 02:13:44 user nova-compute[75257]: </domain>
Nov 14 02:13:44 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.objects.instance [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.objects.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Object Instance<2751bcd6-e958-4216-89f9-5e23f8b9dd9b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8 --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Cannot resize image /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.objects.instance [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'migration_context' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.objects.base [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Object Instance<2751bcd6-e958-4216-89f9-5e23f8b9dd9b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550486898',display_name='tempest-TestMinimumBasicScenario-server-550486898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550486898',id=18,image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCerez3qRud3tNAAT12b+t4i+0H7Sr5njhlCmhyMPjU2JaLT1djZUoYL1W2kD0Bsh7apkcxxkNW/Nd2lfcp9UJBVsonfsZCS9Q4VFC2iCaV+Xa1MxoJDOhjo3xsuwm5kw==',key_name='tempest-TestMinimumBasicScenario-1349261540',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9cfe231fae1941f4970c17e344df8b81',ramdisk_id='',reservation_id='r-p0leackj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1293674307',owner_user_name='tempest-TestMinimumBasicScenario-1293674307-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:13:42Z,user_data=None,user_id='87f69eeadbaf45bfa01dfdfa5efcccb3',uuid=2751bcd6-e958-4216-89f9-5e23f8b9dd9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converting VIF {"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG os_vif [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f871b633-4f08-5f0f-8d42-297b7c33a7cc', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde607b68-f2, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde607b68-f2, col_values=(('qos', UUID('33249690-ec71-45cc-a685-4a1c6bcbb7ec')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde607b68-f2, col_values=(('external_ids', {'iface-id': 'de607b68-f250-49c9-ac97-489a341f5963', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:88:d1', 'vm-uuid': '2751bcd6-e958-4216-89f9-5e23f8b9dd9b'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:45 user nova-compute[75257]: INFO os_vif [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2')
Nov 14 02:13:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] No waiting events found dispatching network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:47 user nova-compute[75257]: WARNING nova.compute.manager [req-f95624df-ff40-414d-8a4f-0717ff8714bc req-bbd27e62-88e7-4584-83ad-ad493a7fc360 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received unexpected event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 02:13:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:13:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Instance rebooted successfully.
Nov 14 02:13:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:13:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54ab118b-feea-4ae9-bef0-7e68fb81c802 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.451s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] No waiting events found dispatching network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:49 user nova-compute[75257]: WARNING nova.compute.manager [req-fe00d87a-ec9c-4e94-9700-cfcdba63e43a req-fa32d51f-f272-4f46-8b6c-283d345d7a85 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received unexpected event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 for instance with vm_state active and task_state None.
Nov 14 02:13:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:51 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:13:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:53 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:13:53 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:13:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquired lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'info_cache' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updating instance_info_cache with network_info: [{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Releasing lock "refresh_cache-71a9d20f-e79b-4716-abf8-a15330742167" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:13:54 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance destroyed successfully.
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'resources' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-437502509',display_name='tempest-AttachVolumeTestJSON-server-437502509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-437502509',id=2,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw==',key_name='tempest-keypair-94073184',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-k6t0eual',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=71a9d20f-e79b-4716-abf8-a15330742167,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG os_vif [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc019053-7c, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce0bf627-a656-4fb3-b347-af97aea52ea9) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:54 user nova-compute[75257]: INFO os_vif [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c')
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Start _get_guest_xml network_info=[{"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'numa_topology' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-437502509',display_name='tempest-AttachVolumeTestJSON-server-437502509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-437502509',id=2,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw==',key_name='tempest-keypair-94073184',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-k6t0eual',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=71a9d20f-e79b-4716-abf8-a15330742167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'pci_devices' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:13:54 user nova-compute[75257]:   <uuid>71a9d20f-e79b-4716-abf8-a15330742167</uuid>
Nov 14 02:13:54 user nova-compute[75257]:   <name>instance-00000002</name>
Nov 14 02:13:54 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:13:54 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:13:54 user nova-compute[75257]:   <metadata>
Nov 14 02:13:54 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:13:54 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:13:54 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeTestJSON-server-437502509</nova:name>
Nov 14 02:13:54 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:13:54</nova:creationTime>
Nov 14 02:13:54 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:13:54 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:13:54 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:13:54 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:13:54 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:13:54 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:13:54 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:13:54 user nova-compute[75257]:       <nova:owner>
Nov 14 02:13:54 user nova-compute[75257]:         <nova:user uuid="4002c20dcbc94a8ea540419f20f8621e">tempest-AttachVolumeTestJSON-1670713184-project-member</nova:user>
Nov 14 02:13:54 user nova-compute[75257]:         <nova:project uuid="246dd4dc2106412bb0ca5e71670d9557">tempest-AttachVolumeTestJSON-1670713184</nova:project>
Nov 14 02:13:54 user nova-compute[75257]:       </nova:owner>
Nov 14 02:13:54 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:13:54 user nova-compute[75257]:       <nova:ports>
Nov 14 02:13:54 user nova-compute[75257]:         <nova:port uuid="cc019053-7c21-4e5c-981e-389fe4a4beed">
Nov 14 02:13:54 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 02:13:54 user nova-compute[75257]:         </nova:port>
Nov 14 02:13:54 user nova-compute[75257]:       </nova:ports>
Nov 14 02:13:54 user nova-compute[75257]:     </nova:instance>
Nov 14 02:13:54 user nova-compute[75257]:   </metadata>
Nov 14 02:13:54 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:13:54 user nova-compute[75257]:     <system>
Nov 14 02:13:54 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:13:54 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:13:54 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:13:54 user nova-compute[75257]:       <entry name="serial">71a9d20f-e79b-4716-abf8-a15330742167</entry>
Nov 14 02:13:54 user nova-compute[75257]:       <entry name="uuid">71a9d20f-e79b-4716-abf8-a15330742167</entry>
Nov 14 02:13:54 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:13:54 user nova-compute[75257]:     </system>
Nov 14 02:13:54 user nova-compute[75257]:   </sysinfo>
Nov 14 02:13:54 user nova-compute[75257]:   <os>
Nov 14 02:13:54 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:13:54 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:13:54 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:13:54 user nova-compute[75257]:   </os>
Nov 14 02:13:54 user nova-compute[75257]:   <features>
Nov 14 02:13:54 user nova-compute[75257]:     <acpi/>
Nov 14 02:13:54 user nova-compute[75257]:     <apic/>
Nov 14 02:13:54 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:13:54 user nova-compute[75257]:   </features>
Nov 14 02:13:54 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:13:54 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:13:54 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:13:54 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:13:54 user nova-compute[75257]:   </clock>
Nov 14 02:13:54 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:13:54 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:13:54 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:13:54 user nova-compute[75257]:   </cpu>
Nov 14 02:13:54 user nova-compute[75257]:   <devices>
Nov 14 02:13:54 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:13:54 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:13:54 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk"/>
Nov 14 02:13:54 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:13:54 user nova-compute[75257]:     </disk>
Nov 14 02:13:54 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:13:54 user nova-compute[75257]:       <mac address="fa:16:3e:69:41:ac"/>
Nov 14 02:13:54 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:13:54 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:13:54 user nova-compute[75257]:       <target dev="tapcc019053-7c"/>
Nov 14 02:13:54 user nova-compute[75257]:     </interface>
Nov 14 02:13:54 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:13:54 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/console.log" append="off"/>
Nov 14 02:13:54 user nova-compute[75257]:     </serial>
Nov 14 02:13:54 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:13:54 user nova-compute[75257]:     <video>
Nov 14 02:13:54 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:13:54 user nova-compute[75257]:     </video>
Nov 14 02:13:54 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:13:54 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:13:54 user nova-compute[75257]:     </rng>
Nov 14 02:13:54 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:13:54 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:13:54 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:13:54 user nova-compute[75257]:     </memballoon>
Nov 14 02:13:54 user nova-compute[75257]:   </devices>
Nov 14 02:13:54 user nova-compute[75257]: </domain>
Nov 14 02:13:54 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:13:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'trusted_certs' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG nova.objects.base [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.196s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Cannot resize image /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'migration_context' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG nova.objects.base [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Object Instance<71a9d20f-e79b-4716-abf8-a15330742167> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-437502509',display_name='tempest-AttachVolumeTestJSON-server-437502509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-437502509',id=2,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw==',key_name='tempest-keypair-94073184',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-k6t0eual',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=71a9d20f-e79b-4716-abf8-a15330742167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG os_vif [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a61d4ccd-5716-5aa3-aa4c-ed448c97684b', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc019053-7c, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc019053-7c, col_values=(('qos', UUID('9d6978b7-defd-49df-9a1c-8467a927a604')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc019053-7c, col_values=(('external_ids', {'iface-id': 'cc019053-7c21-4e5c-981e-389fe4a4beed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:41:ac', 'vm-uuid': '71a9d20f-e79b-4716-abf8-a15330742167'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:13:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:55 user nova-compute[75257]: INFO os_vif [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c')
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.389s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:57 user nova-compute[75257]: WARNING nova.compute.manager [req-0d02484d-8249-49e1-9db1-f79664441053 req-ba3746e2-2caf-462d-ab69-e6a0cc1aa350 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state stopped and task_state powering-on.
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] No waiting events found dispatching network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:13:59 user nova-compute[75257]: WARNING nova.compute.manager [req-0fae36a7-c27e-4c16-bd28-18fda01fb0e1 req-1880b736-2308-4e57-a829-9e61156d9685 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received unexpected event network-vif-plugged-cc019053-7c21-4e5c-981e-389fe4a4beed for instance with vm_state stopped and task_state powering-on.
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:13:59 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance rebooted successfully.
Nov 14 02:13:59 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:59 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=25.265724182128906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5d853d9a-3541-4b16-97dc-942a9700a855 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 71a9d20f-e79b-4716-abf8-a15330742167 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2f9df98c-7814-419d-8821-d8c571972f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance c226a1bf-4b89-49e0-ad8f-149849f12639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:13:59 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:14:00 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:14:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:14:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:14:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:14:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:14:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Updating instance_info_cache with network_info: [{"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-2f9df98c-7814-419d-8821-d8c571972f0e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:14:02 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:14:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:14:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:14 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:14:14 user nova-compute[75257]: INFO nova.compute.claims [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Claim successful on node user
Nov 14 02:14:15 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:14:15 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:14:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:14:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:14:15 user nova-compute[75257]: DEBUG nova.network.neutron [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:14:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:14:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:14:15 user nova-compute[75257]: INFO nova.virt.block_device [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Booting with blank volume at /dev/vda
Nov 14 02:14:15 user nova-compute[75257]: DEBUG nova.policy [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:14:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:16 user nova-compute[75257]: DEBUG nova.network.neutron [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Successfully created port: 88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:14:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Successfully updated port: 88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquired lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-changed-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Refreshing instance network info cache due to event network-changed-88e98b9f-7f03-4af9-a6a6-e512673f84ae. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] Acquiring lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updating instance_info_cache with network_info: [{"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Releasing lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Instance network_info: |[{"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] Acquired lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Refreshing network info cache for port 88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updated VIF entry in instance network info cache for port 88e98b9f-7f03-4af9-a6a6-e512673f84ae. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updating instance_info_cache with network_info: [{"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81d28950-1b69-4ac7-996b-4bcdf81cced1 req-5227ccf8-ab40-4a8a-9905-02bec361af14 service nova] Releasing lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:14:19 user nova-compute[75257]: INFO nova.compute.manager [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Rescuing
Nov 14 02:14:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquired lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:19 user nova-compute[75257]: DEBUG nova.network.neutron [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:14:19 user nova-compute[75257]: DEBUG nova.network.neutron [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updating instance_info_cache with network_info: [{"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Releasing lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:14:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-unplugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] No waiting events found dispatching network-vif-unplugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:14:20 user nova-compute[75257]: WARNING nova.compute.manager [req-edd19c11-26d5-4a00-98f3-f843368a4900 req-f0143e24-23c2-43a6-bd54-34d5d0a560bc service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received unexpected event network-vif-unplugged-38baa7d3-e79c-48c0-a478-d946f09f9787 for instance with vm_state active and task_state rescuing.
Nov 14 02:14:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Instance destroyed successfully.
Nov 14 02:14:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Attempting rescue
Nov 14 02:14:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75257) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Instance directory exists: not creating {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 02:14:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Creating image(s)
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG nova.objects.instance [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'trusted_certs' on Instance uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.252s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue" returned: 0 in 0.073s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.instance [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'migration_context' on Instance uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.base [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<aef5782b-9a73-4309-a559-4a81d3c5ce2e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Start _get_guest_xml network_info=[{"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "vif_mac": "fa:16:3e:68:bd:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.instance [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'resources' on Instance uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.base [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<aef5782b-9a73-4309-a559-4a81d3c5ce2e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.instance [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'numa_topology' on Instance uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.base [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<aef5782b-9a73-4309-a559-4a81d3c5ce2e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:14:21 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:14:21 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.instance [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'vcpu_model' on Instance uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.base [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<aef5782b-9a73-4309-a559-4a81d3c5ce2e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-439193571',display_name='tempest-ServerRescueNegativeTestJSON-server-439193571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-439193571',id=20,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-c10r056v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:12:36Z,user_data=None,user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=aef5782b-9a73-4309-a559-4a81d3c5ce2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "vif_mac": "fa:16:3e:68:bd:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "vif_mac": "fa:16:3e:68:bd:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=38baa7d3-e79c-48c0-a478-d946f09f9787,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38baa7d3-e7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.instance [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'pci_devices' on Instance uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.objects.base [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<aef5782b-9a73-4309-a559-4a81d3c5ce2e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:14:21 user nova-compute[75257]:   <uuid>aef5782b-9a73-4309-a559-4a81d3c5ce2e</uuid>
Nov 14 02:14:21 user nova-compute[75257]:   <name>instance-00000014</name>
Nov 14 02:14:21 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:14:21 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:14:21 user nova-compute[75257]:   <metadata>
Nov 14 02:14:21 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:14:21 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:14:21 user nova-compute[75257]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-439193571</nova:name>
Nov 14 02:14:21 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:14:21</nova:creationTime>
Nov 14 02:14:21 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:14:21 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:14:21 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:14:21 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:14:21 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:14:21 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:14:21 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:14:21 user nova-compute[75257]:       <nova:owner>
Nov 14 02:14:21 user nova-compute[75257]:         <nova:user uuid="a5f8a4942cb54c9aa5377e6d2df1aa7b">tempest-ServerRescueNegativeTestJSON-66746497-project-member</nova:user>
Nov 14 02:14:21 user nova-compute[75257]:         <nova:project uuid="68ac9795cbe748fc8079de4bb8234cd3">tempest-ServerRescueNegativeTestJSON-66746497</nova:project>
Nov 14 02:14:21 user nova-compute[75257]:       </nova:owner>
Nov 14 02:14:21 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:14:21 user nova-compute[75257]:       <nova:ports>
Nov 14 02:14:21 user nova-compute[75257]:         <nova:port uuid="38baa7d3-e79c-48c0-a478-d946f09f9787">
Nov 14 02:14:21 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 02:14:21 user nova-compute[75257]:         </nova:port>
Nov 14 02:14:21 user nova-compute[75257]:       </nova:ports>
Nov 14 02:14:21 user nova-compute[75257]:     </nova:instance>
Nov 14 02:14:21 user nova-compute[75257]:   </metadata>
Nov 14 02:14:21 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:14:21 user nova-compute[75257]:     <system>
Nov 14 02:14:21 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:14:21 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:14:21 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:14:21 user nova-compute[75257]:       <entry name="serial">aef5782b-9a73-4309-a559-4a81d3c5ce2e</entry>
Nov 14 02:14:21 user nova-compute[75257]:       <entry name="uuid">aef5782b-9a73-4309-a559-4a81d3c5ce2e</entry>
Nov 14 02:14:21 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:14:21 user nova-compute[75257]:     </system>
Nov 14 02:14:21 user nova-compute[75257]:   </sysinfo>
Nov 14 02:14:21 user nova-compute[75257]:   <os>
Nov 14 02:14:21 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:14:21 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:14:21 user nova-compute[75257]:   </os>
Nov 14 02:14:21 user nova-compute[75257]:   <features>
Nov 14 02:14:21 user nova-compute[75257]:     <acpi/>
Nov 14 02:14:21 user nova-compute[75257]:     <apic/>
Nov 14 02:14:21 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:14:21 user nova-compute[75257]:   </features>
Nov 14 02:14:21 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:14:21 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:14:21 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:14:21 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:14:21 user nova-compute[75257]:   </clock>
Nov 14 02:14:21 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:14:21 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:14:21 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:14:21 user nova-compute[75257]:   </cpu>
Nov 14 02:14:21 user nova-compute[75257]:   <devices>
Nov 14 02:14:21 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:14:21 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:14:21 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue"/>
Nov 14 02:14:21 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:14:21 user nova-compute[75257]:     </disk>
Nov 14 02:14:21 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:14:21 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:14:21 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk"/>
Nov 14 02:14:21 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:14:21 user nova-compute[75257]:     </disk>
Nov 14 02:14:21 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:14:21 user nova-compute[75257]:       <mac address="fa:16:3e:68:bd:de"/>
Nov 14 02:14:21 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:14:21 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:14:21 user nova-compute[75257]:       <target dev="tap38baa7d3-e7"/>
Nov 14 02:14:21 user nova-compute[75257]:     </interface>
Nov 14 02:14:21 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:14:21 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/console.log" append="off"/>
Nov 14 02:14:21 user nova-compute[75257]:     </serial>
Nov 14 02:14:21 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:14:21 user nova-compute[75257]:     <video>
Nov 14 02:14:21 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:14:21 user nova-compute[75257]:     </video>
Nov 14 02:14:21 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:14:21 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:14:21 user nova-compute[75257]:     </rng>
Nov 14 02:14:21 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:14:21 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:14:21 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:14:21 user nova-compute[75257]:     </memballoon>
Nov 14 02:14:21 user nova-compute[75257]:   </devices>
Nov 14 02:14:21 user nova-compute[75257]: </domain>
Nov 14 02:14:21 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:14:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Instance destroyed successfully.
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No VIF found with MAC fa:16:3e:68:bd:de, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG os_brick.utils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a89c2f-f157-401f-8944-32bd5ac45193]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[74edd846-1925-4627-b298-164d6703c616]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3950f3-778e-469f-bea5-787fe3953ff6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46c55c-2ae4-458f-b576-34777a88d1ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:14:21 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:14:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e393ea8-b3fa-4ad6-a9b0-a6e70b5a28ea]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG os_brick.utils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updating existing volume attachment record: fe691954-5790-4c23-8b23-ad72994a29b4 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:14:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] No waiting events found dispatching network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:14:22 user nova-compute[75257]: WARNING nova.compute.manager [req-a29c95e3-d745-4b5b-8eea-c5693d69bb16 req-490b33f1-c98b-4667-ad1a-4809ad875110 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received unexpected event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 for instance with vm_state active and task_state rescuing.
Nov 14 02:14:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] No waiting events found dispatching network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:14:24 user nova-compute[75257]: WARNING nova.compute.manager [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received unexpected event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 for instance with vm_state active and task_state rescuing.
Nov 14 02:14:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] No waiting events found dispatching network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:14:24 user nova-compute[75257]: WARNING nova.compute.manager [req-5fe964a8-95e0-4f47-a78f-11f464f8fa08 req-3a2554a7-aee8-4df6-998b-2c8840bed62e service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received unexpected event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 for instance with vm_state active and task_state rescuing.
Nov 14 02:14:25 user nova-compute[75257]: DEBUG nova.compute.manager [None req-08bff08c-ab8d-40b2-92ff-ce47a1edec9f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:14:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:14:26 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Creating image(s)
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Ensure instance console log exists: /opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Start _get_guest_xml network_info=[{"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fe691954-5790-4c23-8b23-ad72994a29b4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTuxVNGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab639b27-9978-41c7-b93d-e18bd4af09d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef89d81b-e5bf-41ab-a543-9a59db55976d', 'serial': 'ef89d81b-e5bf-41ab-a543-9a59db55976d'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:14:26 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:14:26 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTuxVNGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:14:26 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:14:26 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:14:26 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ca366-0a6f-4864-ba7a-febb453a3925]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:14:26 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0c354e-1cd5-4daa-bffe-da2d9f626ac4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d] added
Nov 14 02:14:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6088a25b-59c4-4fe7-84af-4b1ee444152b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf7a4a2-c249-4c5d-9e16-f3a091241884]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kTuxVNGw {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kTuxVNGw" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76848d6-b3df-4d98-90a2-de0cd879ae13]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kTuxVNGw'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbc1d73-f950-4562-a121-0c3384d4100b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e86b6c4-7969-4995-84c5-f8a6579870b4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:14:26 user nova-compute[75257]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:14:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:14:26 user nova-compute[75257]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:14:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[011b8ead-e6fa-4803-a80f-3c834a4593c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d, portal: 172.16.0.220,3260]
Nov 14 02:14:26 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d, portal: 172.16.0.220,3260] successful.
Nov 14 02:14:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7521ad-4569-4f5a-8b12-8cbf98eb53fb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b38f470-6145-4744-80d9-64d26c226241]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:14:26 user nova-compute[75257]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:14:26 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:14:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:14:26 user nova-compute[75257]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:14:26 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:14:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c75f484-ff24-44be-b953-91f50279c1c4]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTuxVNGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:14:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23061653630623666', 'path': '/dev/sdd'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061653630623666', 'path': '/dev/sdd'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1905828341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1905828341',id=23,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-iv0rdupj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:15Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=ab639b27-9978-41c7-b93d-e18bd4af09d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f6:3b,bridge_name='br-int',has_traffic_filtering=True,id=88e98b9f-7f03-4af9-a6a6-e512673f84ae,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e98b9f-7f') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.objects.instance [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'pci_devices' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:14:27 user nova-compute[75257]:   <uuid>ab639b27-9978-41c7-b93d-e18bd4af09d7</uuid>
Nov 14 02:14:27 user nova-compute[75257]:   <name>instance-00000017</name>
Nov 14 02:14:27 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:14:27 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:14:27 user nova-compute[75257]:   <metadata>
Nov 14 02:14:27 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:14:27 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:14:27 user nova-compute[75257]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1905828341</nova:name>
Nov 14 02:14:27 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:14:26</nova:creationTime>
Nov 14 02:14:27 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:14:27 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:14:27 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:14:27 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:14:27 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:14:27 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:14:27 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:14:27 user nova-compute[75257]:       <nova:owner>
Nov 14 02:14:27 user nova-compute[75257]:         <nova:user uuid="addcfdac50de4b03bd3ad3142508edea">tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member</nova:user>
Nov 14 02:14:27 user nova-compute[75257]:         <nova:project uuid="ac29176de8fc434285721bbb6759966d">tempest-ServerBootFromVolumeStableRescueTest-1355021813</nova:project>
Nov 14 02:14:27 user nova-compute[75257]:       </nova:owner>
Nov 14 02:14:27 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:14:27 user nova-compute[75257]:       <nova:ports>
Nov 14 02:14:27 user nova-compute[75257]:         <nova:port uuid="88e98b9f-7f03-4af9-a6a6-e512673f84ae">
Nov 14 02:14:27 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 02:14:27 user nova-compute[75257]:         </nova:port>
Nov 14 02:14:27 user nova-compute[75257]:       </nova:ports>
Nov 14 02:14:27 user nova-compute[75257]:     </nova:instance>
Nov 14 02:14:27 user nova-compute[75257]:   </metadata>
Nov 14 02:14:27 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:14:27 user nova-compute[75257]:     <system>
Nov 14 02:14:27 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:14:27 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:14:27 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:14:27 user nova-compute[75257]:       <entry name="serial">ab639b27-9978-41c7-b93d-e18bd4af09d7</entry>
Nov 14 02:14:27 user nova-compute[75257]:       <entry name="uuid">ab639b27-9978-41c7-b93d-e18bd4af09d7</entry>
Nov 14 02:14:27 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:14:27 user nova-compute[75257]:     </system>
Nov 14 02:14:27 user nova-compute[75257]:   </sysinfo>
Nov 14 02:14:27 user nova-compute[75257]:   <os>
Nov 14 02:14:27 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:14:27 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:14:27 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:14:27 user nova-compute[75257]:   </os>
Nov 14 02:14:27 user nova-compute[75257]:   <features>
Nov 14 02:14:27 user nova-compute[75257]:     <acpi/>
Nov 14 02:14:27 user nova-compute[75257]:     <apic/>
Nov 14 02:14:27 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:14:27 user nova-compute[75257]:   </features>
Nov 14 02:14:27 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:14:27 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:14:27 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:14:27 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:14:27 user nova-compute[75257]:   </clock>
Nov 14 02:14:27 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:14:27 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:14:27 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:14:27 user nova-compute[75257]:   </cpu>
Nov 14 02:14:27 user nova-compute[75257]:   <devices>
Nov 14 02:14:27 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:14:27 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:14:27 user nova-compute[75257]:       <source dev="/dev/sdd"/>
Nov 14 02:14:27 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:14:27 user nova-compute[75257]:       <serial>ef89d81b-e5bf-41ab-a543-9a59db55976d</serial>
Nov 14 02:14:27 user nova-compute[75257]:     </disk>
Nov 14 02:14:27 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:14:27 user nova-compute[75257]:       <mac address="fa:16:3e:5c:f6:3b"/>
Nov 14 02:14:27 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:14:27 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:14:27 user nova-compute[75257]:       <target dev="tap88e98b9f-7f"/>
Nov 14 02:14:27 user nova-compute[75257]:     </interface>
Nov 14 02:14:27 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:14:27 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/console.log" append="off"/>
Nov 14 02:14:27 user nova-compute[75257]:     </serial>
Nov 14 02:14:27 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:14:27 user nova-compute[75257]:     <video>
Nov 14 02:14:27 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:14:27 user nova-compute[75257]:     </video>
Nov 14 02:14:27 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:14:27 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:14:27 user nova-compute[75257]:     </rng>
Nov 14 02:14:27 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:14:27 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:14:27 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:14:27 user nova-compute[75257]:     </memballoon>
Nov 14 02:14:27 user nova-compute[75257]:   </devices>
Nov 14 02:14:27 user nova-compute[75257]: </domain>
Nov 14 02:14:27 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1905828341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1905828341',id=23,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-iv0rdupj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:15Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=ab639b27-9978-41c7-b93d-e18bd4af09d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f6:3b,bridge_name='br-int',has_traffic_filtering=True,id=88e98b9f-7f03-4af9-a6a6-e512673f84ae,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e98b9f-7f') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG os_vif [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f6:3b,bridge_name='br-int',has_traffic_filtering=True,id=88e98b9f-7f03-4af9-a6a6-e512673f84ae,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e98b9f-7f') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f97c7b86-eb95-59f7-83c9-1870b7d5d8a3', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88e98b9f-7f, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88e98b9f-7f, col_values=(('qos', UUID('a146a8cb-a046-4e8b-adf8-a7218c5e919b')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88e98b9f-7f, col_values=(('external_ids', {'iface-id': '88e98b9f-7f03-4af9-a6a6-e512673f84ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:f6:3b', 'vm-uuid': 'ab639b27-9978-41c7-b93d-e18bd4af09d7'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:27 user nova-compute[75257]: INFO os_vif [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:f6:3b,bridge_name='br-int',has_traffic_filtering=True,id=88e98b9f-7f03-4af9-a6a6-e512673f84ae,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e98b9f-7f')
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:14:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No VIF found with MAC fa:16:3e:5c:f6:3b, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:14:29 user nova-compute[75257]: WARNING nova.compute.manager [req-91c75558-a704-4f86-a9a8-be3f6559789c req-0ecd5153-3deb-42a3-9b94-12669de457bc service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state building and task_state spawning.
Nov 14 02:14:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:14:31 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Instance spawned successfully.
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:14:31 user nova-compute[75257]: INFO nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:14:31 user nova-compute[75257]: WARNING nova.compute.manager [req-c1fc605f-d5c6-48ce-a612-c90070c403c9 req-0f365cf4-d9b4-43fd-a0f6-b3b952a07af9 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state building and task_state spawning.
Nov 14 02:14:31 user nova-compute[75257]: INFO nova.compute.manager [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Took 16.73 seconds to build instance.
Nov 14 02:14:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-67af88ea-4fe4-4b5c-a240-946c54b10b34 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.860s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "2f9df98c-7814-419d-8821-d8c571972f0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "2f9df98c-7814-419d-8821-d8c571972f0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:36 user nova-compute[75257]: INFO nova.compute.manager [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Terminating instance
Nov 14 02:14:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received event network-vif-unplugged-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] Acquiring lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] No waiting events found dispatching network-vif-unplugged-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-b8b434fd-466d-41bd-8bb1-e8ea2769ce0a req-4e0f3b73-acea-4197-9d5a-2ecfc515a0a7 service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received event network-vif-unplugged-592113b0-b777-4a01-ac6c-d5337e7d773a for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:14:37 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Instance destroyed successfully.
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lazy-loading 'resources' on Instance uuid 2f9df98c-7814-419d-8821-d8c571972f0e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1271828340',display_name='tempest-ServersNegativeTestJSON-server-1271828340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1271828340',id=3,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df2958ade8524b6e9c245384d7fe9b92',ramdisk_id='',reservation_id='r-5zcyqpa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1705676333',owner_user_name='tempest-ServersNegativeTestJSON-1705676333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:15Z,user_data=None,user_id='1bf2a54e5cb84e16b3218e3ca1f2fbdc',uuid=2f9df98c-7814-419d-8821-d8c571972f0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converting VIF {"id": "592113b0-b777-4a01-ac6c-d5337e7d773a", "address": "fa:16:3e:e3:50:2e", "network": {"id": "f3895747-ee7e-46a0-8759-2a4f3e01b728", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1577301620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df2958ade8524b6e9c245384d7fe9b92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592113b0-b7", "ovs_interfaceid": "592113b0-b777-4a01-ac6c-d5337e7d773a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:50:2e,bridge_name='br-int',has_traffic_filtering=True,id=592113b0-b777-4a01-ac6c-d5337e7d773a,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592113b0-b7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG os_vif [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:50:2e,bridge_name='br-int',has_traffic_filtering=True,id=592113b0-b777-4a01-ac6c-d5337e7d773a,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592113b0-b7') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap592113b0-b7, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6529333e-7612-4312-9782-e5ce3676b4ed) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:14:37 user nova-compute[75257]: INFO nova.compute.manager [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Detaching volume 57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:14:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:14:37 user nova-compute[75257]: INFO os_vif [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:50:2e,bridge_name='br-int',has_traffic_filtering=True,id=592113b0-b777-4a01-ac6c-d5337e7d773a,network=Network(f3895747-ee7e-46a0-8759-2a4f3e01b728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592113b0-b7')
Nov 14 02:14:37 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Deleting instance files /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e_del
Nov 14 02:14:37 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Deletion of /opt/stack/data/nova/instances/2f9df98c-7814-419d-8821-d8c571972f0e_del complete
Nov 14 02:14:37 user nova-compute[75257]: INFO nova.compute.manager [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 02:14:37 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:14:37 user nova-compute[75257]: INFO nova.virt.block_device [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Attempting to driver detach volume 57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 from mountpoint /dev/vdb
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Attempting to detach device vdb from instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:14:37 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:14:37 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:14:37 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:14:37 user nova-compute[75257]:   <serial>57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1</serial>
Nov 14 02:14:37 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 02:14:37 user nova-compute[75257]: </disk>
Nov 14 02:14:37 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:14:37 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully detached device vdb from instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 from the persistent domain config.
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:14:37 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:14:37 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:14:37 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:14:37 user nova-compute[75257]:   <serial>57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1</serial>
Nov 14 02:14:37 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 02:14:37 user nova-compute[75257]: </disk>
Nov 14 02:14:37 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:37 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Took 0.60 seconds to deallocate network for instance.
Nov 14 02:14:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-77b1730c-e92c-43fe-946a-a72481fea56e req-ada8b562-89a0-4c98-9932-28ed6d457a14 service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received event network-vif-deleted-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:38 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:14:38 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:14:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:38 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Deleted allocations for instance 2f9df98c-7814-419d-8821-d8c571972f0e
Nov 14 02:14:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f286ece-ae97-4a36-8e21-d5468f3c0983 tempest-ServersNegativeTestJSON-1705676333 tempest-ServersNegativeTestJSON-1705676333-project-member] Lock "2f9df98c-7814-419d-8821-d8c571972f0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received event network-vif-plugged-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] Acquiring lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] Lock "2f9df98c-7814-419d-8821-d8c571972f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] No waiting events found dispatching network-vif-plugged-592113b0-b777-4a01-ac6c-d5337e7d773a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:14:39 user nova-compute[75257]: WARNING nova.compute.manager [req-9ab984f4-452f-41ba-889f-069ca2b4ca97 req-1cbae8d8-9a25-4093-9973-911d52d95aac service nova] [instance: 2f9df98c-7814-419d-8821-d8c571972f0e] Received unexpected event network-vif-plugged-592113b0-b777-4a01-ac6c-d5337e7d773a for instance with vm_state deleted and task_state None.
Nov 14 02:14:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:14:50 user nova-compute[75257]: INFO nova.compute.claims [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Claim successful on node user
Nov 14 02:14:50 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:14:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:14:50 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:14:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:14:51 user nova-compute[75257]: INFO nova.virt.block_device [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Booting with volume 42dbd7d9-2083-4d89-be08-66361918c52d at /dev/vda
Nov 14 02:14:51 user nova-compute[75257]: DEBUG os_brick.utils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[74575ee3-8616-448b-8ad2-9e6c42599326]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af662b73-2174-4482-ba13-dc38e78a2008]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[61406d45-0ece-4d2b-9a48-050eac05f0c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed070bb-3c7a-49c4-bfae-b2353d94f673]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG nova.policy [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e82c04681c164b6fb997c0f97e9c77ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e1d90f2eaae4b19883b23e8aaa8f47a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:14:51 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa22c51-0587-41f1-8cfa-03b960152c37]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG os_brick.utils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating existing volume attachment record: 8e22dc0d-fb83-40ec-886f-28001e300a51 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-changed-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Refreshing instance network info cache due to event network-changed-ed73d0a9-0d24-470f-9fef-56c5474f0a9e. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] Acquiring lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] Acquired lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Refreshing network info cache for port ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updated VIF entry in instance network info cache for port ed73d0a9-0d24-470f-9fef-56c5474f0a9e. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating instance_info_cache with network_info: [{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bb4e85b8-76c6-46fb-acdf-50941615528f req-57596845-0c69-4a3c-8e76-018148531f3a service nova] Releasing lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:14:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:52 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully created port: 531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:14:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:52 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully created port: f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:14:53 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully created port: e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:14:53 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:53 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:54 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully created port: f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:14:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:54 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:14:54 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully created port: e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully updated port: 531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-changed-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing instance network info cache due to event network-changed-531edd6a-d4a2-4d1a-a02d-e5efa760b394. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] Acquiring lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] Acquired lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing network info cache for port 531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:14:55 user nova-compute[75257]: INFO nova.virt.block_device [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Booting with volume 9dfc9d29-0d9c-406b-bc49-d31ed7396b22 at /dev/vdb
Nov 14 02:14:55 user nova-compute[75257]: DEBUG os_brick.utils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcac700-2e37-4436-9421-82a678d3c2cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[96748b6e-5359-4038-8aed-891316e792a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2720a782-497b-41b4-97f0-431d0319276b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1368007-dcea-46d1-95eb-2e842e4d27a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:14:55 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:14:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9574ebb-e503-4269-9e32-9d4356b7fa1d]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:14:55 user nova-compute[75257]: DEBUG os_brick.utils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating existing volume attachment record: 678b1625-98c8-4815-8086-bdcfb0ac91b3 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG nova.network.neutron [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d6b40301-7e6b-4df7-926c-9a264a66722d req-9ca7e989-7934-4e2a-9bb8-f93d54f5d7ad service nova] Releasing lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully updated port: f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:14:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updating instance_info_cache with network_info: [{"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-changed-f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing instance network info cache due to event network-changed-f4ac726b-9912-4b5f-b751-3ca0a0621e09. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] Acquiring lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] Acquired lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.network.neutron [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing network info cache for port f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully updated port: 4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.network.neutron [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:14:57 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 is timed out.
Nov 14 02:14:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully detached device vdb from instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 from the live domain config.
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CczKsNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:14:57 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:14:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3074b128-7a42-4142-8b5b-72860eb245b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received event network-changed-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Refreshing instance network info cache due to event network-changed-4f86002d-ead3-4d58-be50-4e1d2c09896a. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] Acquiring lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] Acquired lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG nova.network.neutron [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Refreshing network info cache for port 4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:14:57 user nova-compute[75257]: No targets found.
Nov 14 02:14:57 user nova-compute[75257]: iSNS:
Nov 14 02:14:57 user nova-compute[75257]: No targets found.
Nov 14 02:14:57 user nova-compute[75257]: STATIC:
Nov 14 02:14:57 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082
Nov 14 02:14:57 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:14:57 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:14:57 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:14:57 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:14:57 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:14:57 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1
Nov 14 02:14:57 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:14:57 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:14:57 user nova-compute[75257]: FIRMWARE:
Nov 14 02:14:57 user nova-compute[75257]: No targets found.
Nov 14 02:14:57 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:14:57 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:14:57 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:14:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea15d2e-ebd9-4d47-a68b-295719d22f4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f56eb3e-d588-411f-bd93-475d82f02867]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:14:58 user nova-compute[75257]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:14:58 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:14:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 (non-flash)
Nov 14 02:14:58 user nova-compute[75257]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:14:58 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:14:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c39fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fbc7a1-7bbf-4683-9cf7-65f33fd6235e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[141503bb-b66e-4e2b-acb2-aa08b31f59a6]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de24cb1-4eda-4465-bc0e-182cecd354bf]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e3f506-26b4-4ca6-85bd-45f672f732d7]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7e1781-171d-425e-8319-68c9df4d02aa]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG nova.network.neutron [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f28f29f5-a5da-414a-97c9-73d2cb26c0ca req-2abac521-0834-404c-a285-585b6809a53f service nova] Releasing lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0223d67-9ccc-478d-9d57-08e4355b3978]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260]
Nov 14 02:14:58 user nova-compute[75257]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1, portal: 172.16.0.220,3260] successful.
Nov 14 02:14:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e88e4c-ecca-4dc2-906d-df6a3d9b9fb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4070fa-4299-478c-8ba0-635b8ae500ca]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== disconnect_volume: return (423ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'flavor' on Instance uuid c226a1bf-4b89-49e0-ad8f-149849f12639 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully updated port: f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG nova.network.neutron [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Updated VIF entry in instance network info cache for port 4f86002d-ead3-4d58-be50-4e1d2c09896a. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG nova.network.neutron [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Updating instance_info_cache with network_info: [{"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:14:58 user nova-compute[75257]: INFO nova.compute.manager [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Attaching volume 490a80de-6c27-4e49-b5d1-5fcbfffa3f34 to /dev/vdb
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-865df2a4-ed23-401a-ac36-f7458dcb9123 req-aa4bc7dd-5add-4725-a581-8143946d59d3 service nova] Releasing lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.utils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[39764c7e-6b36-4bbd-b499-0a0fffbdc161]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8ee2d3-a5d0-4083-b41e-cc16329d329c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba0d18a-cf78-4c67-9b88-1dd2f9fe7fea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ec2335-6bf6-4a91-b4c8-3c74bf5d4e7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:14:58 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:14:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b002d1-c1ff-4a89-9968-d85ebd5a8f8b]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG os_brick.utils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:14:58 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Updating existing volume attachment record: a9119380-4828-479b-ad06-a4009446e665 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'flavor' on Instance uuid b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7f44e8b8-813a-441b-9e88-73889fc9f2ed tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.987s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully updated port: e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-changed-4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing instance network info cache due to event network-changed-4c7870e4-5a12-40e6-a06c-e635347f66f5. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Acquiring lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Acquired lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing network info cache for port 4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:14:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Releasing lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-changed-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing instance network info cache due to event network-changed-f3041f35-502b-4bb9-9e73-13fe8aa11484. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Acquiring lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Acquired lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing network info cache for port f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:00 user nova-compute[75257]: INFO nova.virt.block_device [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Booting with volume 82b62c9e-80a8-43bc-b6ec-67fffaff059a at /dev/vdc
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully updated port: f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG os_brick.utils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce761df8-2be6-4e6d-9f97-54cb0980fb25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9924cf-3676-4c0f-a86a-37ecf6f770c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c0ad20-16ea-4913-b77b-b0d5c0629c48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7c0079-1f1d-41b4-a8c5-f07dc33b428a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Releasing lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-changed-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing instance network info cache due to event network-changed-e3b64855-b03b-4ee1-8c89-6e3abc178faa. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Acquiring lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Acquired lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing network info cache for port e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:15:01 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:15:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccca18a7-45ac-4172-8866-7394a188ca15]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG os_brick.utils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating existing volume attachment record: 78dc6975-9ae0-4432-b94f-6bebe4bcfc87 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG nova.network.neutron [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG nova.network.neutron [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-065abc82-a117-45b6-889a-bab9078d69dd req-e928507b-6170-4a82-962d-489c01c423c5 service nova] Releasing lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:15:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Successfully updated port: e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-changed-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing instance network info cache due to event network-changed-f13dd1ab-e475-40ad-a7d9-18d96362a10d. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] Acquiring lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] Acquired lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing network info cache for port f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:15:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7579MB free_disk=25.26816177368164GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 71a9d20f-e79b-4716-abf8-a15330742167 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance c226a1bf-4b89-49e0-ad8f-149849f12639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b83173e-f47e-4f40-881e-df5ff83eb994 req-ca97c8bd-5c02-489f-b845-e6d29217997a service nova] Releasing lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquired lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:15:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhTJvGra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:15:03 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:03 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:03 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1a43be-abaf-4408-9322-475844fc5f9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:15:03 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7989fd-16eb-4548-a571-fbfb5d3953d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34] added
Nov 14 02:15:03 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6be487-740e-4759-845b-252f255c717c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-changed-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing instance network info cache due to event network-changed-e2acc9ad-f868-4e07-83c4-b87a1f08e670. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] Acquiring lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae0505-45fd-456b-97be-bd98aa2d4907]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhTJvGra {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QhTJvGra" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9defca91-bfdd-4c6a-afac-e25489e15665]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QhTJvGra'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c85760-9d11-40df-8706-fb9db0b0e7f2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d0528d-d6af-41e2-8d94-704bda74e222]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:03 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:03 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:03 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:03 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0d78c8-c8f4-42f0-a1b5-8545bbc44775]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34, portal: 172.16.0.220,3260]
Nov 14 02:15:03 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34, portal: 172.16.0.220,3260] successful.
Nov 14 02:15:03 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb127327-b4dc-4a37-9718-c5c53111dae1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d1d86c-db7c-443d-98db-3b62df63fd15]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:04 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:04 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:04 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:04 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef3f64e-19ed-4c53-8204-254303b07897]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhTJvGra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [{"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Releasing lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance network_info: |[{"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] Acquired lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG nova.network.neutron [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing network info cache for port e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG nova.network.neutron [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updated VIF entry in instance network info cache for port e2acc9ad-f868-4e07-83c4-b87a1f08e670. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG nova.network.neutron [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [{"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1469138e-cce7-4565-812a-9ec3efea1470 req-3cf7a9f8-d7f5-403c-b1bc-fa081e0490f4 service nova] Releasing lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23930626466386264', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930626466386264', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'flavor' on Instance uuid c226a1bf-4b89-49e0-ad8f-149849f12639 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:15:05 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:15:05 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:15:05 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:15:05 user nova-compute[75257]:   <serial>490a80de-6c27-4e49-b5d1-5fcbfffa3f34</serial>
Nov 14 02:15:05 user nova-compute[75257]: </disk>
Nov 14 02:15:05 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No VIF found with MAC fa:16:3e:39:61:93, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7d8cd54d-526d-4a5b-8eaf-5cb0363e368f tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.915s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:15:05 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Creating image(s)
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Ensure instance console log exists: /opt/stack/data/nova/instances/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Start _get_guest_xml network_info=[{"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8e22dc0d-fb83-40ec-886f-28001e300a51', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPNVIjbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88', 'attached_at': '', 'detached_at': '', 'volume_id': '42dbd7d9-2083-4d89-be08-66361918c52d', 'serial': '42dbd7d9-2083-4d89-be08-66361918c52d'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '678b1625-98c8-4815-8086-bdcfb0ac91b3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdnyQhwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88', 'attached_at': '', 'detached_at': '', 'volume_id': '9dfc9d29-0d9c-406b-bc49-d31ed7396b22', 'serial': '9dfc9d29-0d9c-406b-bc49-d31ed7396b22'}, 'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '78dc6975-9ae0-4432-b94f-6bebe4bcfc87', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTVKriOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88', 'attached_at': '', 'detached_at': '', 'volume_id': '82b62c9e-80a8-43bc-b6ec-67fffaff059a', 'serial': '82b62c9e-80a8-43bc-b6ec-67fffaff059a'}, 'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:15:05 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:15:05 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPNVIjbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:15:05 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:05 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:05 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[02566812-8cc8-4bb4-b942-1a943725c0e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:15:05 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[318e7488-16fb-4a07-8975-ed87e54dc2de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d] added
Nov 14 02:15:05 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660e4a2-ef09-4b3d-9a36-3646b2da6f05]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06a6163-7f14-4747-be3a-729f04be10ba]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPNVIjbv {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPNVIjbv" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a45822-bda8-41d5-9c89-7b6a219a4da2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pPNVIjbv'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd99826-e9f0-4bd4-9a4f-9a1e36bba86b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a1a615-cb59-41be-8d5c-7d8cb664e54b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c029d80f-5b90-44de-891d-cff23ad36dc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d, portal: 172.16.0.220,3260]
Nov 14 02:15:06 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d, portal: 172.16.0.220,3260] successful.
Nov 14 02:15:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa28f94-3773-4612-ae09-962681310324]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[15745ce0-bf2b-4d6f-bd05-b5113820844c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:06 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[875450bc-0460-4097-9a55-1692e83a72b5]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPNVIjbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:15:06 user nova-compute[75257]: INFO nova.compute.claims [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Claim successful on node user
Nov 14 02:15:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:15:07 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:15:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG nova.policy [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:15:07 user nova-compute[75257]: INFO nova.virt.block_device [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Booting with volume snapshot c55f3a07-6ed6-4529-a229-3f3ce92e8bc1 at /dev/vda
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26565313537626363', 'path': '/dev/sde'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565313537626363', 'path': '/dev/sde'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdnyQhwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:15:07 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:07 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:07 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9efbcf2-aabb-4d12-8a32-126ea51b70ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:15:07 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee46401f-1e04-4eda-b7a5-47ffc85e7403]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22] added
Nov 14 02:15:07 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf8caf6-3109-4b92-aa65-d4f8b66aa247]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd613c-2355-4e75-8419-36e081931aaf]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdnyQhwM {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdnyQhwM" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648a9f6-a6c3-4362-aab6-482e2e0d63eb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sdnyQhwM'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e65ad84-41e1-4e54-a648-ea1196344064]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6819f65-dc67-42ab-92f6-f87ea1ed68af]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:07 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:07 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[13274a8a-821b-4e8f-afe4-6902b6ec8a13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22, portal: 172.16.0.220,3260]
Nov 14 02:15:07 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22, portal: 172.16.0.220,3260] successful.
Nov 14 02:15:07 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34aabb8-9938-468d-aa0e-9821997694ff]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0ff236-5e32-47d4-a0c1-22f22ccbe2b7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:07 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:07 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[63063e37-2196-4b6c-a2eb-f04194fa9192]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdnyQhwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:15:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Successfully created port: 03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:08 user nova-compute[75257]: INFO nova.compute.manager [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Detaching volume 490a80de-6c27-4e49-b5d1-5fcbfffa3f34
Nov 14 02:15:08 user nova-compute[75257]: INFO nova.virt.block_device [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Attempting to driver detach volume 490a80de-6c27-4e49-b5d1-5fcbfffa3f34 from mountpoint /dev/vdb
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Attempting to detach device vdb from instance c226a1bf-4b89-49e0-ad8f-149849f12639 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:15:08 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:15:08 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:15:08 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:15:08 user nova-compute[75257]:   <serial>490a80de-6c27-4e49-b5d1-5fcbfffa3f34</serial>
Nov 14 02:15:08 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:15:08 user nova-compute[75257]: </disk>
Nov 14 02:15:08 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:15:08 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Successfully detached device vdb from instance c226a1bf-4b89-49e0-ad8f-149849f12639 from the persistent domain config.
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c226a1bf-4b89-49e0-ad8f-149849f12639 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:15:08 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:15:08 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:15:08 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:15:08 user nova-compute[75257]:   <serial>490a80de-6c27-4e49-b5d1-5fcbfffa3f34</serial>
Nov 14 02:15:08 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:15:08 user nova-compute[75257]: </disk>
Nov 14 02:15:08 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Successfully updated port: 03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "refresh_cache-ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquired lock "refresh_cache-ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received event network-changed-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Refreshing instance network info cache due to event network-changed-03336681-82cb-4a6f-b9a2-f429ade55494. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] Acquiring lock "refresh_cache-ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23033343233643333', 'path': '/dev/sdf'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033343233643333', 'path': '/dev/sdf'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c226a1bf-4b89-49e0-ad8f-149849f12639 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTVKriOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:15:08 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:08 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:08 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ff612-2238-4942-b90e-4a697c5b70ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:15:08 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b6d67d-7216-49c1-a9e0-d2f65828be23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a] added
Nov 14 02:15:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cc05b2-03eb-4e38-8d2b-f09e515753de]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[951fa5d5-f725-4422-bbe3-dc014e5324be]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTVKriOR {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTVKriOR" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7be4fc9-0278-422b-861b-db8dbe6310cf]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wTVKriOR'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e60e08-4dc8-43bf-bf12-a3e202a7c97b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Updating instance_info_cache with network_info: [{"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Releasing lock "refresh_cache-ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Instance network_info: |[{"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] Acquired lock "refresh_cache-ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG nova.network.neutron [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Refreshing network info cache for port 03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5d3823-5e79-4fd0-9ebf-ddbf8019e84d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:08 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:08 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:08 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:08 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:08 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:08 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:08 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:08 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e6ce4-5eae-4196-a6b6-2e4e589749a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a, portal: 172.16.0.220,3260]
Nov 14 02:15:08 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a, portal: 172.16.0.220,3260] successful.
Nov 14 02:15:08 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e0a590-b282-4782-ba51-3916431bc3cd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd652232-4d6e-4cef-9604-291de3c1a1ea]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:09 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfc1e32-8b7e-423c-b84e-75d731f6ce00]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTVKriOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Updated VIF entry in instance network info cache for port 03336681-82cb-4a6f-b9a2-f429ade55494. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Updating instance_info_cache with network_info: [{"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-98e41543-1ca7-415a-b4f3-2bdda0cc4704 req-bfa89d57-894d-4782-9672-fe66668f2731 service nova] Releasing lock "refresh_cache-ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23165643264333433', 'path': '/dev/sdg'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165643264333433', 'path': '/dev/sdg'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:2e:f5,bridge_name='br-int',has_traffic_filtering=True,id=531edd6a-d4a2-4d1a-a02d-e5efa760b394,network=Network(f4b66683-d156-4859-8b77-bbcee566de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531edd6a-d4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:45:58,bridge_name='br-int',has_traffic_filtering=True,id=f4ac726b-9912-4b5f-b751-3ca0a0621e09,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4ac726b-99') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=4c7870e4-5a12-40e6-a06c-e635347f66f5,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c7870e4-5a') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=f3041f35-502b-4bb9-9e73-13fe8aa11484,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3041f35-50') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:9f:b6,bridge_name='br-int',has_traffic_filtering=True,id=e3b64855-b03b-4ee1-8c89-6e3abc178faa,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3b64855-b0') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=f13dd1ab-e475-40ad-a7d9-18d96362a10d,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13dd1ab-e4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=e2acc9ad-f868-4e07-83c4-b87a1f08e670,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2acc9ad-f8') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.objects.instance [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lazy-loading 'pci_devices' on Instance uuid 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:15:10 user nova-compute[75257]:   <uuid>54817bdb-e0cc-4168-bf4f-1e47e6fe7a88</uuid>
Nov 14 02:15:10 user nova-compute[75257]:   <name>instance-00000018</name>
Nov 14 02:15:10 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:15:10 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:15:10 user nova-compute[75257]:   <metadata>
Nov 14 02:15:10 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:15:10 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:15:10 user nova-compute[75257]:       <nova:name>tempest-device-tagging-server-1744950715</nova:name>
Nov 14 02:15:10 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:15:05</nova:creationTime>
Nov 14 02:15:10 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:15:10 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:15:10 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:15:10 user nova-compute[75257]:       <nova:owner>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:user uuid="e82c04681c164b6fb997c0f97e9c77ec">tempest-TaggedBootDevicesTest-333319311-project-member</nova:user>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:project uuid="9e1d90f2eaae4b19883b23e8aaa8f47a">tempest-TaggedBootDevicesTest-333319311</nova:project>
Nov 14 02:15:10 user nova-compute[75257]:       </nova:owner>
Nov 14 02:15:10 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:15:10 user nova-compute[75257]:       <nova:ports>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:port uuid="531edd6a-d4a2-4d1a-a02d-e5efa760b394">
Nov 14 02:15:10 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 02:15:10 user nova-compute[75257]:         </nova:port>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:port uuid="f4ac726b-9912-4b5f-b751-3ca0a0621e09">
Nov 14 02:15:10 user nova-compute[75257]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Nov 14 02:15:10 user nova-compute[75257]:         </nova:port>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:port uuid="4c7870e4-5a12-40e6-a06c-e635347f66f5">
Nov 14 02:15:10 user nova-compute[75257]:           <nova:ip type="fixed" address="10.1.1.29" ipVersion="4"/>
Nov 14 02:15:10 user nova-compute[75257]:         </nova:port>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:port uuid="f3041f35-502b-4bb9-9e73-13fe8aa11484">
Nov 14 02:15:10 user nova-compute[75257]:           <nova:ip type="fixed" address="10.1.1.18" ipVersion="4"/>
Nov 14 02:15:10 user nova-compute[75257]:         </nova:port>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:port uuid="e3b64855-b03b-4ee1-8c89-6e3abc178faa">
Nov 14 02:15:10 user nova-compute[75257]:           <nova:ip type="fixed" address="10.1.1.249" ipVersion="4"/>
Nov 14 02:15:10 user nova-compute[75257]:         </nova:port>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:port uuid="f13dd1ab-e475-40ad-a7d9-18d96362a10d">
Nov 14 02:15:10 user nova-compute[75257]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 02:15:10 user nova-compute[75257]:         </nova:port>
Nov 14 02:15:10 user nova-compute[75257]:         <nova:port uuid="e2acc9ad-f868-4e07-83c4-b87a1f08e670">
Nov 14 02:15:10 user nova-compute[75257]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 02:15:10 user nova-compute[75257]:         </nova:port>
Nov 14 02:15:10 user nova-compute[75257]:       </nova:ports>
Nov 14 02:15:10 user nova-compute[75257]:     </nova:instance>
Nov 14 02:15:10 user nova-compute[75257]:   </metadata>
Nov 14 02:15:10 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:15:10 user nova-compute[75257]:     <system>
Nov 14 02:15:10 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:15:10 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:15:10 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:15:10 user nova-compute[75257]:       <entry name="serial">54817bdb-e0cc-4168-bf4f-1e47e6fe7a88</entry>
Nov 14 02:15:10 user nova-compute[75257]:       <entry name="uuid">54817bdb-e0cc-4168-bf4f-1e47e6fe7a88</entry>
Nov 14 02:15:10 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:15:10 user nova-compute[75257]:     </system>
Nov 14 02:15:10 user nova-compute[75257]:   </sysinfo>
Nov 14 02:15:10 user nova-compute[75257]:   <os>
Nov 14 02:15:10 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:15:10 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:15:10 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:15:10 user nova-compute[75257]:   </os>
Nov 14 02:15:10 user nova-compute[75257]:   <features>
Nov 14 02:15:10 user nova-compute[75257]:     <acpi/>
Nov 14 02:15:10 user nova-compute[75257]:     <apic/>
Nov 14 02:15:10 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:15:10 user nova-compute[75257]:   </features>
Nov 14 02:15:10 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:15:10 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:15:10 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:15:10 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:15:10 user nova-compute[75257]:   </clock>
Nov 14 02:15:10 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:15:10 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:15:10 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:15:10 user nova-compute[75257]:   </cpu>
Nov 14 02:15:10 user nova-compute[75257]:   <devices>
Nov 14 02:15:10 user nova-compute[75257]:     <disk type="file" device="cdrom">
Nov 14 02:15:10 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 02:15:10 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/disk.config"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="hda" bus="ide"/>
Nov 14 02:15:10 user nova-compute[75257]:     </disk>
Nov 14 02:15:10 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:15:10 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:15:10 user nova-compute[75257]:       <source dev="/dev/sde"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <serial>42dbd7d9-2083-4d89-be08-66361918c52d</serial>
Nov 14 02:15:10 user nova-compute[75257]:     </disk>
Nov 14 02:15:10 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:15:10 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:15:10 user nova-compute[75257]:       <source dev="/dev/sdf"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <serial>9dfc9d29-0d9c-406b-bc49-d31ed7396b22</serial>
Nov 14 02:15:10 user nova-compute[75257]:     </disk>
Nov 14 02:15:10 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:15:10 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:15:10 user nova-compute[75257]:       <source dev="/dev/sdg"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="vdc" bus="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <serial>82b62c9e-80a8-43bc-b6ec-67fffaff059a</serial>
Nov 14 02:15:10 user nova-compute[75257]:     </disk>
Nov 14 02:15:10 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:15:10 user nova-compute[75257]:       <mac address="fa:16:3e:d9:2e:f5"/>
Nov 14 02:15:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="tap531edd6a-d4"/>
Nov 14 02:15:10 user nova-compute[75257]:     </interface>
Nov 14 02:15:10 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:15:10 user nova-compute[75257]:       <mac address="fa:16:3e:29:45:58"/>
Nov 14 02:15:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="tapf4ac726b-99"/>
Nov 14 02:15:10 user nova-compute[75257]:     </interface>
Nov 14 02:15:10 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:15:10 user nova-compute[75257]:       <mac address="fa:16:3e:2d:bd:2f"/>
Nov 14 02:15:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="tap4c7870e4-5a"/>
Nov 14 02:15:10 user nova-compute[75257]:     </interface>
Nov 14 02:15:10 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:15:10 user nova-compute[75257]:       <mac address="fa:16:3e:54:3d:ee"/>
Nov 14 02:15:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="tapf3041f35-50"/>
Nov 14 02:15:10 user nova-compute[75257]:     </interface>
Nov 14 02:15:10 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:15:10 user nova-compute[75257]:       <mac address="fa:16:3e:61:9f:b6"/>
Nov 14 02:15:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="tape3b64855-b0"/>
Nov 14 02:15:10 user nova-compute[75257]:     </interface>
Nov 14 02:15:10 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:15:10 user nova-compute[75257]:       <mac address="fa:16:3e:8a:ea:bd"/>
Nov 14 02:15:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="tapf13dd1ab-e4"/>
Nov 14 02:15:10 user nova-compute[75257]:     </interface>
Nov 14 02:15:10 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:15:10 user nova-compute[75257]:       <mac address="fa:16:3e:61:a0:5e"/>
Nov 14 02:15:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:15:10 user nova-compute[75257]:       <target dev="tape2acc9ad-f8"/>
Nov 14 02:15:10 user nova-compute[75257]:     </interface>
Nov 14 02:15:10 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:15:10 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/console.log" append="off"/>
Nov 14 02:15:10 user nova-compute[75257]:     </serial>
Nov 14 02:15:10 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:15:10 user nova-compute[75257]:     <video>
Nov 14 02:15:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:10 user nova-compute[75257]:     </video>
Nov 14 02:15:10 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:15:10 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:15:10 user nova-compute[75257]:     </rng>
Nov 14 02:15:10 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:15:10 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:15:10 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:15:10 user nova-compute[75257]:     </memballoon>
Nov 14 02:15:10 user nova-compute[75257]:   </devices>
Nov 14 02:15:10 user nova-compute[75257]: </domain>
Nov 14 02:15:10 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:2e:f5,bridge_name='br-int',has_traffic_filtering=True,id=531edd6a-d4a2-4d1a-a02d-e5efa760b394,network=Network(f4b66683-d156-4859-8b77-bbcee566de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531edd6a-d4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:2e:f5,bridge_name='br-int',has_traffic_filtering=True,id=531edd6a-d4a2-4d1a-a02d-e5efa760b394,network=Network(f4b66683-d156-4859-8b77-bbcee566de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531edd6a-d4') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b39e3d83-8a2d-5685-ad96-773983d400eb', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap531edd6a-d4, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap531edd6a-d4, col_values=(('qos', UUID('5a90726c-8c0d-4beb-9578-9575e061e737')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap531edd6a-d4, col_values=(('external_ids', {'iface-id': '531edd6a-d4a2-4d1a-a02d-e5efa760b394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:2e:f5', 'vm-uuid': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: INFO os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:2e:f5,bridge_name='br-int',has_traffic_filtering=True,id=531edd6a-d4a2-4d1a-a02d-e5efa760b394,network=Network(f4b66683-d156-4859-8b77-bbcee566de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531edd6a-d4')
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:45:58,bridge_name='br-int',has_traffic_filtering=True,id=f4ac726b-9912-4b5f-b751-3ca0a0621e09,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4ac726b-99') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:45:58,bridge_name='br-int',has_traffic_filtering=True,id=f4ac726b-9912-4b5f-b751-3ca0a0621e09,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4ac726b-99') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e808e7cd-e96e-553c-95cc-6b719d6e71a9', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4ac726b-99, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4ac726b-99, col_values=(('qos', UUID('7f6c8700-e0f4-4997-aa27-f90699d28a25')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4ac726b-99, col_values=(('external_ids', {'iface-id': 'f4ac726b-9912-4b5f-b751-3ca0a0621e09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:45:58', 'vm-uuid': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: INFO os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:45:58,bridge_name='br-int',has_traffic_filtering=True,id=f4ac726b-9912-4b5f-b751-3ca0a0621e09,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4ac726b-99')
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=4c7870e4-5a12-40e6-a06c-e635347f66f5,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c7870e4-5a') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=4c7870e4-5a12-40e6-a06c-e635347f66f5,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c7870e4-5a') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31b59954-265c-50fb-9c6b-6cbf9b34726c', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c7870e4-5a, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c7870e4-5a, col_values=(('qos', UUID('53fda5ca-b506-4992-87ec-82f8467899c6')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c7870e4-5a, col_values=(('external_ids', {'iface-id': '4c7870e4-5a12-40e6-a06c-e635347f66f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:bd:2f', 'vm-uuid': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: INFO os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=4c7870e4-5a12-40e6-a06c-e635347f66f5,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c7870e4-5a')
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=f3041f35-502b-4bb9-9e73-13fe8aa11484,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3041f35-50') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=f3041f35-502b-4bb9-9e73-13fe8aa11484,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3041f35-50') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '527d2e76-00b6-51b0-9c3a-8e64dc70b16e', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3041f35-50, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3041f35-50, col_values=(('qos', UUID('588b8ee9-4a76-4e77-993a-21ddc55523e2')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3041f35-50, col_values=(('external_ids', {'iface-id': 'f3041f35-502b-4bb9-9e73-13fe8aa11484', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:3d:ee', 'vm-uuid': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: INFO os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=f3041f35-502b-4bb9-9e73-13fe8aa11484,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3041f35-50')
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:9f:b6,bridge_name='br-int',has_traffic_filtering=True,id=e3b64855-b03b-4ee1-8c89-6e3abc178faa,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3b64855-b0') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:9f:b6,bridge_name='br-int',has_traffic_filtering=True,id=e3b64855-b03b-4ee1-8c89-6e3abc178faa,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3b64855-b0') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9c913f8-bd83-5bcb-975a-ff1a03ea864b', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3b64855-b0, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3b64855-b0, col_values=(('qos', UUID('36bad62b-6011-4de0-931b-afcef4ef1d42')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3b64855-b0, col_values=(('external_ids', {'iface-id': 'e3b64855-b03b-4ee1-8c89-6e3abc178faa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:9f:b6', 'vm-uuid': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: INFO os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:9f:b6,bridge_name='br-int',has_traffic_filtering=True,id=e3b64855-b03b-4ee1-8c89-6e3abc178faa,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3b64855-b0')
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=f13dd1ab-e475-40ad-a7d9-18d96362a10d,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13dd1ab-e4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=f13dd1ab-e475-40ad-a7d9-18d96362a10d,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13dd1ab-e4') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a9f1cdb-c370-5522-afc2-9b211e903132', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf13dd1ab-e4, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf13dd1ab-e4, col_values=(('qos', UUID('0e06af27-f76b-4f66-a40b-80d2d045a654')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf13dd1ab-e4, col_values=(('external_ids', {'iface-id': 'f13dd1ab-e475-40ad-a7d9-18d96362a10d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:ea:bd', 'vm-uuid': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: INFO os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=f13dd1ab-e475-40ad-a7d9-18d96362a10d,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13dd1ab-e4')
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=e2acc9ad-f868-4e07-83c4-b87a1f08e670,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2acc9ad-f8') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=e2acc9ad-f868-4e07-83c4-b87a1f08e670,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2acc9ad-f8') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e6df3f5-1f0f-553f-98af-54ec2e753cef', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2acc9ad-f8, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2acc9ad-f8, col_values=(('qos', UUID('5ed7ef55-b55b-4643-a838-3161f333e227')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2acc9ad-f8, col_values=(('external_ids', {'iface-id': 'e2acc9ad-f868-4e07-83c4-b87a1f08e670', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:a0:5e', 'vm-uuid': '54817bdb-e0cc-4168-bf4f-1e47e6fe7a88'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:10 user nova-compute[75257]: INFO os_vif [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=e2acc9ad-f868-4e07-83c4-b87a1f08e670,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2acc9ad-f8')
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] No BDM found with device name hda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] No VIF found with MAC fa:16:3e:d9:2e:f5, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:15:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] No VIF found with MAC fa:16:3e:61:9f:b6, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:15:10 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Using config drive
Nov 14 02:15:11 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Creating config drive at /opt/stack/data/nova/instances/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/disk.config
Nov 14 02:15:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzwfkzx1l {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzwfkzx1l" returned: 0 in 0.053s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG os_brick.utils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fed840-6cd5-4035-a7b0-62bd12fd0742]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb5ee7b-0c95-4ec7-ba01-07b93a7641ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f0b64b-7c27-4c9e-a22e-da322f8c63eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd385ed-67c4-4c36-a970-e42caa374175]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:15:12 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:15:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3338a3-9ee5-4267-8f19-e64dfa9d4c2a]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG os_brick.utils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Updating existing volume attachment record: a1573762-351a-4878-b61b-c38c34f5ad1c {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:15:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:13 user nova-compute[75257]: WARNING nova.compute.manager [req-fa39a680-23dc-4b06-9c04-bd47535e2a71 req-c50a3ff6-bbe8-465e-a927-3463fc752ecc service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance with vm_state building and task_state spawning.
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:13 user nova-compute[75257]: WARNING nova.compute.manager [req-09c09c29-efbc-4648-a28c-f2d5f97683ee req-b424391d-d008-4037-9ba3-2216ef2c901d service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 for instance with vm_state building and task_state spawning.
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:14 user nova-compute[75257]: WARNING nova.compute.manager [req-496e6624-daa6-41e4-bcd2-b5e7c85df7ac req-fb6b6c86-3881-4e8c-a952-f0f18f24730b service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance with vm_state building and task_state spawning.
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:15 user nova-compute[75257]: WARNING nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance with vm_state building and task_state spawning.
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:15 user nova-compute[75257]: WARNING nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 for instance with vm_state building and task_state spawning.
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:15 user nova-compute[75257]: WARNING nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 for instance with vm_state building and task_state spawning.
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:15 user nova-compute[75257]: WARNING nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance with vm_state building and task_state spawning.
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:15 user nova-compute[75257]: WARNING nova.compute.manager [req-81b40bcd-fb77-40ba-88eb-427d23f01bf2 req-8f8d233d-38fa-4488-a9b2-2c43906bb754 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance with vm_state building and task_state spawning.
Nov 14 02:15:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:15 user nova-compute[75257]: WARNING nova.compute.manager [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 for instance with vm_state building and task_state spawning.
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:15 user nova-compute[75257]: WARNING nova.compute.manager [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance with vm_state building and task_state spawning.
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:15 user nova-compute[75257]: WARNING nova.compute.manager [req-d71aa074-127e-47f9-bd5b-cd656d7d6536 req-902cf4bc-3eca-4981-a722-b7ac6e15c8a3 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance with vm_state building and task_state spawning.
Nov 14 02:15:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:16 user nova-compute[75257]: WARNING nova.compute.manager [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance with vm_state building and task_state spawning.
Nov 14 02:15:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:16 user nova-compute[75257]: WARNING nova.compute.manager [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance with vm_state building and task_state spawning.
Nov 14 02:15:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:16 user nova-compute[75257]: WARNING nova.compute.manager [req-0eefe8d5-a45d-412e-89f8-c5dfc2f6c013 req-ce63d1c1-ec46-4dcf-b7d4-215e6274e61f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance with vm_state building and task_state spawning.
Nov 14 02:15:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:15:17 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance spawned successfully.
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:17 user nova-compute[75257]: INFO nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Took 11.30 seconds to spawn the instance on the hypervisor.
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:15:17 user nova-compute[75257]: INFO nova.compute.manager [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Took 26.83 seconds to build instance.
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-51c02965-c262-41be-a343-b3b4f06f7b05 tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.922s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:15:17 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Creating image(s)
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Ensure instance console log exists: /opt/stack/data/nova/instances/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Start _get_guest_xml network_info=[{"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a1573762-351a-4878-b61b-c38c34f5ad1c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqmcNwCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad924c94-eeb6-40d0-87c6-b7bc3e19b36f', 'attached_at': '', 'detached_at': '', 'volume_id': 'edf3820a-42ce-4d67-91f9-d08b4813f305', 'serial': 'edf3820a-42ce-4d67-91f9-d08b4813f305'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:15:17 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:15:17 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqmcNwCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:15:17 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:17 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:17 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb4067-8395-4f65-a0e3-c727ee6212a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:15:17 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[50927059-687a-43d0-add5-16cc3b9ca1a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305] added
Nov 14 02:15:17 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[674982c2-34bd-4f4b-a10a-aba9f81646c9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75aeb8f-4d5c-4c47-8fd6-70cb3cfd39d9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqmcNwCj {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqmcNwCj" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e65a1db-1f95-4a90-9bc0-a24082f7fca7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eqmcNwCj'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ea75a7-a333-4d76-8bc7-ccaf1ff31d90]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5355b1e5-dd11-4c86-834b-ddeb4c68b97c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f629442b-3fed-44e3-b2f7-73ee27edfe2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305, portal: 172.16.0.220,3260]
Nov 14 02:15:18 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305, portal: 172.16.0.220,3260] successful.
Nov 14 02:15:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847e956-f0ff-4f86-af62-02494e7a8e4b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d6bb19-2dc6-4892-a4b5-3273569e3e29]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:18 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:15:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HCTL ('39', '-', '-', 0) found on session 32 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6897eeb7-bed6-4703-accd-18abd8258afe]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching for a device in session 32 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:15:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqmcNwCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23761346236346434', 'path': '/dev/sdh'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761346236346434', 'path': '/dev/sdh'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1951903037',display_name='tempest-TestVolumeBootPattern-server-1951903037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1951903037',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-erfsi4db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:15:07Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=ad924c94-eeb6-40d0-87c6-b7bc3e19b36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:66:3a,bridge_name='br-int',has_traffic_filtering=True,id=03336681-82cb-4a6f-b9a2-f429ade55494,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03336681-82') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'pci_devices' on Instance uuid ad924c94-eeb6-40d0-87c6-b7bc3e19b36f {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:15:19 user nova-compute[75257]:   <uuid>ad924c94-eeb6-40d0-87c6-b7bc3e19b36f</uuid>
Nov 14 02:15:19 user nova-compute[75257]:   <name>instance-00000019</name>
Nov 14 02:15:19 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:15:19 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:15:19 user nova-compute[75257]:   <metadata>
Nov 14 02:15:19 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:15:19 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:15:19 user nova-compute[75257]:       <nova:name>tempest-TestVolumeBootPattern-server-1951903037</nova:name>
Nov 14 02:15:19 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:15:17</nova:creationTime>
Nov 14 02:15:19 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:15:19 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:15:19 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:15:19 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:15:19 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:15:19 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:15:19 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:15:19 user nova-compute[75257]:       <nova:owner>
Nov 14 02:15:19 user nova-compute[75257]:         <nova:user uuid="61052c8663184644aa445e8b29a9d6ed">tempest-TestVolumeBootPattern-1633655156-project-member</nova:user>
Nov 14 02:15:19 user nova-compute[75257]:         <nova:project uuid="6e49d1cf0a1c457ab943ffd360f1c3da">tempest-TestVolumeBootPattern-1633655156</nova:project>
Nov 14 02:15:19 user nova-compute[75257]:       </nova:owner>
Nov 14 02:15:19 user nova-compute[75257]:       <nova:ports>
Nov 14 02:15:19 user nova-compute[75257]:         <nova:port uuid="03336681-82cb-4a6f-b9a2-f429ade55494">
Nov 14 02:15:19 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 02:15:19 user nova-compute[75257]:         </nova:port>
Nov 14 02:15:19 user nova-compute[75257]:       </nova:ports>
Nov 14 02:15:19 user nova-compute[75257]:     </nova:instance>
Nov 14 02:15:19 user nova-compute[75257]:   </metadata>
Nov 14 02:15:19 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:15:19 user nova-compute[75257]:     <system>
Nov 14 02:15:19 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:15:19 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:15:19 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:15:19 user nova-compute[75257]:       <entry name="serial">ad924c94-eeb6-40d0-87c6-b7bc3e19b36f</entry>
Nov 14 02:15:19 user nova-compute[75257]:       <entry name="uuid">ad924c94-eeb6-40d0-87c6-b7bc3e19b36f</entry>
Nov 14 02:15:19 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:15:19 user nova-compute[75257]:     </system>
Nov 14 02:15:19 user nova-compute[75257]:   </sysinfo>
Nov 14 02:15:19 user nova-compute[75257]:   <os>
Nov 14 02:15:19 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:15:19 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:15:19 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:15:19 user nova-compute[75257]:   </os>
Nov 14 02:15:19 user nova-compute[75257]:   <features>
Nov 14 02:15:19 user nova-compute[75257]:     <acpi/>
Nov 14 02:15:19 user nova-compute[75257]:     <apic/>
Nov 14 02:15:19 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:15:19 user nova-compute[75257]:   </features>
Nov 14 02:15:19 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:15:19 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:15:19 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:15:19 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:15:19 user nova-compute[75257]:   </clock>
Nov 14 02:15:19 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:15:19 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:15:19 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:15:19 user nova-compute[75257]:   </cpu>
Nov 14 02:15:19 user nova-compute[75257]:   <devices>
Nov 14 02:15:19 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:15:19 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:15:19 user nova-compute[75257]:       <source dev="/dev/sdh"/>
Nov 14 02:15:19 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:15:19 user nova-compute[75257]:       <serial>edf3820a-42ce-4d67-91f9-d08b4813f305</serial>
Nov 14 02:15:19 user nova-compute[75257]:     </disk>
Nov 14 02:15:19 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:15:19 user nova-compute[75257]:       <mac address="fa:16:3e:65:66:3a"/>
Nov 14 02:15:19 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:19 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:15:19 user nova-compute[75257]:       <target dev="tap03336681-82"/>
Nov 14 02:15:19 user nova-compute[75257]:     </interface>
Nov 14 02:15:19 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:15:19 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f/console.log" append="off"/>
Nov 14 02:15:19 user nova-compute[75257]:     </serial>
Nov 14 02:15:19 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:15:19 user nova-compute[75257]:     <video>
Nov 14 02:15:19 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:19 user nova-compute[75257]:     </video>
Nov 14 02:15:19 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:15:19 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:15:19 user nova-compute[75257]:     </rng>
Nov 14 02:15:19 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:15:19 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:15:19 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:15:19 user nova-compute[75257]:     </memballoon>
Nov 14 02:15:19 user nova-compute[75257]:   </devices>
Nov 14 02:15:19 user nova-compute[75257]: </domain>
Nov 14 02:15:19 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1951903037',display_name='tempest-TestVolumeBootPattern-server-1951903037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1951903037',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-erfsi4db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:15:07Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=ad924c94-eeb6-40d0-87c6-b7bc3e19b36f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:66:3a,bridge_name='br-int',has_traffic_filtering=True,id=03336681-82cb-4a6f-b9a2-f429ade55494,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03336681-82') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG os_vif [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:66:3a,bridge_name='br-int',has_traffic_filtering=True,id=03336681-82cb-4a6f-b9a2-f429ade55494,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03336681-82') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9c134a4-8ba5-593b-bdf9-965d96c3c463', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03336681-82, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03336681-82, col_values=(('qos', UUID('056f318e-49d7-442f-8ec2-90cc7f2934bc')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03336681-82, col_values=(('external_ids', {'iface-id': '03336681-82cb-4a6f-b9a2-f429ade55494', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:66:3a', 'vm-uuid': 'ad924c94-eeb6-40d0-87c6-b7bc3e19b36f'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:19 user nova-compute[75257]: INFO os_vif [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:66:3a,bridge_name='br-int',has_traffic_filtering=True,id=03336681-82cb-4a6f-b9a2-f429ade55494,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03336681-82')
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:15:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No VIF found with MAC fa:16:3e:65:66:3a, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:15:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received event network-vif-plugged-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] Acquiring lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] No waiting events found dispatching network-vif-plugged-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:20 user nova-compute[75257]: WARNING nova.compute.manager [req-51b12677-68d8-4ea4-a8ad-f8c0a98785e5 req-0e592a0f-1808-4ad2-b65a-3f7baa8d469e service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received unexpected event network-vif-plugged-03336681-82cb-4a6f-b9a2-f429ade55494 for instance with vm_state building and task_state spawning.
Nov 14 02:15:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received event network-vif-plugged-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] Acquiring lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] No waiting events found dispatching network-vif-plugged-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:22 user nova-compute[75257]: WARNING nova.compute.manager [req-51ea8b22-e731-4c4b-b70a-a39abbdd95c8 req-4000912d-aa8f-427d-aa86-da6fdcc1f91a service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received unexpected event network-vif-plugged-03336681-82cb-4a6f-b9a2-f429ade55494 for instance with vm_state building and task_state spawning.
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:15:22 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Instance spawned successfully.
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:23 user nova-compute[75257]: INFO nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 14 02:15:23 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:15:23 user nova-compute[75257]: INFO nova.compute.manager [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Took 16.62 seconds to build instance.
Nov 14 02:15:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dfa2f21-815f-4b35-836d-c5a5fb694736 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.708s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:27 user nova-compute[75257]: INFO nova.compute.manager [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Terminating instance
Nov 14 02:15:27 user nova-compute[75257]: DEBUG nova.compute.manager [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-unplugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] No waiting events found dispatching network-vif-unplugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-3f98619a-2982-485e-be24-8ecf2a0a0103 req-1b93fda2-2ef7-4b71-b739-21791dc0b869 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-unplugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Instance destroyed successfully.
Nov 14 02:15:28 user nova-compute[75257]: DEBUG nova.objects.instance [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'resources' on Instance uuid b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1741521006',display_name='tempest-ServerActionsTestOtherA-server-1571034706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1741521006',id=15,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvMChb+aecwn40wfnvjF+Z4X1IXJnC2lqu7jzDw+N4Tyc9AiF8NWxVLA5y/hDnNYJ0o67tDS/YoN1aso6ftvlo/jonqLcgPcHXmzabpe0UOICeVkW5vaXUUBYQhWe3WJQ==',key_name='tempest-keypair-808543668',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:12:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-t9n8uyh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:12:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "address": "fa:16:3e:a5:e0:91", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7908eb-09", "ovs_interfaceid": "6e7908eb-09c1-4662-b587-2a28838e6ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_vif [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e7908eb-09, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1db009b3-5444-490b-9e88-f8f3f8d6b672) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:28 user nova-compute[75257]: INFO os_vif [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:e0:91,bridge_name='br-int',has_traffic_filtering=True,id=6e7908eb-09c1-4662-b587-2a28838e6ca6,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7908eb-09')
Nov 14 02:15:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Deleting instance files /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146_del
Nov 14 02:15:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Deletion of /opt/stack/data/nova/instances/b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146_del complete
Nov 14 02:15:28 user nova-compute[75257]: INFO nova.compute.manager [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:15:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c226a1bf-4b89-49e0-ad8f-149849f12639 is timed out.
Nov 14 02:15:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Successfully detached device vdb from instance c226a1bf-4b89-49e0-ad8f-149849f12639 from the live domain config.
Nov 14 02:15:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QhTJvGra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:15:28 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[79807177-d743-493b-a8c3-0f3b285cbb09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:15:28 user nova-compute[75257]: No targets found.
Nov 14 02:15:28 user nova-compute[75257]: iSNS:
Nov 14 02:15:28 user nova-compute[75257]: No targets found.
Nov 14 02:15:28 user nova-compute[75257]: STATIC:
Nov 14 02:15:28 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22
Nov 14 02:15:28 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:28 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:28 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082
Nov 14 02:15:28 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:28 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:28 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a
Nov 14 02:15:28 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:28 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:28 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305
Nov 14 02:15:28 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:28 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:28 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:15:28 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:28 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:28 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d
Nov 14 02:15:28 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:28 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:28 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34
Nov 14 02:15:28 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:28 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:28 user nova-compute[75257]: FIRMWARE:
Nov 14 02:15:28 user nova-compute[75257]: No targets found.
Nov 14 02:15:28 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:15:28 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:15:28 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66dc69d-8298-42e0-a11f-d83b2aec109e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2587d35b-6770-4ae4-95ba-6fa4641dada4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:15:28 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:28 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:15:28 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a46330a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f48d9-8ad2-402a-a63c-3e619444460c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c21838-5931-42c9-8833-3865c14ca0d8]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bb98a2-7386-471c-8a3e-f06f8f064dd8]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bbc551-646c-4d90-8a24-77ff206b5cfa]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3213582-11e4-486d-a71c-40ba41048410]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2b2fe3-2f60-46dc-be59-88743bd6eb91]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34, portal: 172.16.0.220,3260]
Nov 14 02:15:28 user nova-compute[75257]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34, portal: 172.16.0.220,3260] successful.
Nov 14 02:15:28 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:490a80de-6c27-4e49-b5d1-5fcbfffa3f34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[758dc14e-394e-4ade-9836-17249c6cdb99]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] <== disconnect_volume: return (346ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:29 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Took 1.21 seconds to deallocate network for instance.
Nov 14 02:15:29 user nova-compute[75257]: DEBUG nova.objects.instance [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'flavor' on Instance uuid c226a1bf-4b89-49e0-ad8f-149849f12639 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-24350cc9-2d85-427a-a2c1-34b3d9e9503f req-5dd67d46-0f7e-497a-a300-52a474608001 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-deleted-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3e1807c8-63c4-43a8-bcdf-7b49c664e447 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.692s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:30 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:15:30 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:15:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] Acquiring lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] No waiting events found dispatching network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:30 user nova-compute[75257]: WARNING nova.compute.manager [req-577e6e5a-c5ad-4192-804d-73c701403099 req-2a26b56a-6225-4c1a-8164-312d2e02c211 service nova] [instance: b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146] Received unexpected event network-vif-plugged-6e7908eb-09c1-4662-b587-2a28838e6ca6 for instance with vm_state deleted and task_state None.
Nov 14 02:15:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:30 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Deleted allocations for instance b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146
Nov 14 02:15:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af11e653-2ea1-4a82-8234-f26c8bb182ea tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "b2ea8aa8-6bfe-40a7-aa3a-7d04d9bf8146" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.858s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:33 user nova-compute[75257]: DEBUG nova.compute.manager [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-changed-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:33 user nova-compute[75257]: DEBUG nova.compute.manager [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing instance network info cache due to event network-changed-de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:15:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] Acquiring lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] Acquired lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:33 user nova-compute[75257]: DEBUG nova.network.neutron [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing network info cache for port de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:15:34 user nova-compute[75257]: DEBUG nova.network.neutron [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updated VIF entry in instance network info cache for port de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:15:34 user nova-compute[75257]: DEBUG nova.network.neutron [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updating instance_info_cache with network_info: [{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fabb5042-3b2a-4690-9f85-4912ca15b39a req-bc9e0b9b-f7f4-4386-a9ce-5891809d09d5 service nova] Releasing lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:34 user nova-compute[75257]: INFO nova.compute.manager [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Detaching volume 8ae6554c-749e-436f-b233-36c7d3784082
Nov 14 02:15:34 user nova-compute[75257]: INFO nova.virt.block_device [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Attempting to driver detach volume 8ae6554c-749e-436f-b233-36c7d3784082 from mountpoint /dev/vdb
Nov 14 02:15:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Attempting to detach device vdb from instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:15:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:15:34 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:15:34 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:15:34 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:15:34 user nova-compute[75257]:   <serial>8ae6554c-749e-436f-b233-36c7d3784082</serial>
Nov 14 02:15:34 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 02:15:34 user nova-compute[75257]: </disk>
Nov 14 02:15:34 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:15:34 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully detached device vdb from instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b from the persistent domain config.
Nov 14 02:15:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:15:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:15:34 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:15:34 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:15:34 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:15:34 user nova-compute[75257]:   <serial>8ae6554c-749e-436f-b233-36c7d3784082</serial>
Nov 14 02:15:34 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 02:15:34 user nova-compute[75257]: </disk>
Nov 14 02:15:34 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:15:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:15:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-changed-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing instance network info cache due to event network-changed-de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:15:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] Acquiring lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] Acquired lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:35 user nova-compute[75257]: DEBUG nova.network.neutron [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Refreshing network info cache for port de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:15:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updated VIF entry in instance network info cache for port de607b68-f250-49c9-ac97-489a341f5963. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:15:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updating instance_info_cache with network_info: [{"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-78d158e3-6563-47e7-96f1-fe31b45e599f req-6462219b-ed29-4a28-9677-3c0c9eda2415 service nova] Releasing lock "refresh_cache-2751bcd6-e958-4216-89f9-5e23f8b9dd9b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "71a9d20f-e79b-4716-abf8-a15330742167-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:45 user nova-compute[75257]: INFO nova.compute.manager [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Terminating instance
Nov 14 02:15:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:15:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Instance destroyed successfully.
Nov 14 02:15:46 user nova-compute[75257]: DEBUG nova.objects.instance [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'resources' on Instance uuid 71a9d20f-e79b-4716-abf8-a15330742167 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-437502509',display_name='tempest-AttachVolumeTestJSON-server-437502509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-437502509',id=2,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oB1aJNgNRQJAzMFcNsDAGHY5C9JFTriFHwP/NPO4gePebzT8odaCggYKm15ZUAlodY3/DGVSo+bQtLoKU12nOZFTEkvDwm4JvMEGiIiffvGijsXz1g4eNh9bOBaesQw==',key_name='tempest-keypair-94073184',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-k6t0eual',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:14:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=71a9d20f-e79b-4716-abf8-a15330742167,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "cc019053-7c21-4e5c-981e-389fe4a4beed", "address": "fa:16:3e:69:41:ac", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc019053-7c", "ovs_interfaceid": "cc019053-7c21-4e5c-981e-389fe4a4beed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG os_vif [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc019053-7c, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d6978b7-defd-49df-9a1c-8467a927a604) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:46 user nova-compute[75257]: INFO os_vif [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:41:ac,bridge_name='br-int',has_traffic_filtering=True,id=cc019053-7c21-4e5c-981e-389fe4a4beed,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc019053-7c')
Nov 14 02:15:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Deleting instance files /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167_del
Nov 14 02:15:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Deletion of /opt/stack/data/nova/instances/71a9d20f-e79b-4716-abf8-a15330742167_del complete
Nov 14 02:15:46 user nova-compute[75257]: INFO nova.compute.manager [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 14 02:15:46 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:46 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:46 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Took 0.81 seconds to deallocate network for instance.
Nov 14 02:15:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-e32bde34-88c0-4635-bb88-4aa9d0da1409 req-aad5e51c-e3cb-4e0a-8944-e5b685d05005 service nova] [instance: 71a9d20f-e79b-4716-abf8-a15330742167] Received event network-vif-deleted-cc019053-7c21-4e5c-981e-389fe4a4beed {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:47 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:15:47 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:15:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:47 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Deleted allocations for instance 71a9d20f-e79b-4716-abf8-a15330742167
Nov 14 02:15:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a9a43845-3c13-4846-a5d7-080c780b90d6 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "71a9d20f-e79b-4716-abf8-a15330742167" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.150s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "4dc3f756-22cd-49c9-bd6e-643c69474512" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:15:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:15:48 user nova-compute[75257]: INFO nova.compute.claims [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Claim successful on node user
Nov 14 02:15:49 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:15:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:15:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG nova.policy [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bcdcb5c382f4e98bcfeb519efe7256b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba8690ce4d3409194d26c988e0c4c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:15:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Creating image(s)
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "/opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "/opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk 1073741824" returned: 0 in 0.048s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Successfully created port: 3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Cannot resize image /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Ensure instance console log exists: /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Successfully updated port: 3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "refresh_cache-4dc3f756-22cd-49c9-bd6e-643c69474512" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquired lock "refresh_cache-4dc3f756-22cd-49c9-bd6e-643c69474512" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received event network-changed-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Refreshing instance network info cache due to event network-changed-3dd03a0a-a809-4e30-ac46-c9beb40caa25. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:15:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] Acquiring lock "refresh_cache-4dc3f756-22cd-49c9-bd6e-643c69474512" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.network.neutron [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.network.neutron [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Updating instance_info_cache with network_info: [{"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Releasing lock "refresh_cache-4dc3f756-22cd-49c9-bd6e-643c69474512" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Instance network_info: |[{"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] Acquired lock "refresh_cache-4dc3f756-22cd-49c9-bd6e-643c69474512" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Refreshing network info cache for port 3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Start _get_guest_xml network_info=[{"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:15:51 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:15:51 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-580478083',display_name='tempest-VolumesActionsTest-instance-580478083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-580478083',id=26,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cba8690ce4d3409194d26c988e0c4c51',ramdisk_id='',reservation_id='r-qazy63z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1429079730',owner_user_name='tempest-VolumesActionsTest-1429079730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:15:49Z,user_data=None,user_id='2bcdcb5c382f4e98bcfeb519efe7256b',uuid=4dc3f756-22cd-49c9-bd6e-643c69474512,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Converting VIF {"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d1:fe,bridge_name='br-int',has_traffic_filtering=True,id=3dd03a0a-a809-4e30-ac46-c9beb40caa25,network=Network(b1575ac8-6126-46b4-9240-a390b02b1e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd03a0a-a8') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.objects.instance [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dc3f756-22cd-49c9-bd6e-643c69474512 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:15:51 user nova-compute[75257]:   <uuid>4dc3f756-22cd-49c9-bd6e-643c69474512</uuid>
Nov 14 02:15:51 user nova-compute[75257]:   <name>instance-0000001a</name>
Nov 14 02:15:51 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:15:51 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:15:51 user nova-compute[75257]:   <metadata>
Nov 14 02:15:51 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:15:51 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:15:51 user nova-compute[75257]:       <nova:name>tempest-VolumesActionsTest-instance-580478083</nova:name>
Nov 14 02:15:51 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:15:51</nova:creationTime>
Nov 14 02:15:51 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:15:51 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:15:51 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:15:51 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:15:51 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:15:51 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:15:51 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:15:51 user nova-compute[75257]:       <nova:owner>
Nov 14 02:15:51 user nova-compute[75257]:         <nova:user uuid="2bcdcb5c382f4e98bcfeb519efe7256b">tempest-VolumesActionsTest-1429079730-project-member</nova:user>
Nov 14 02:15:51 user nova-compute[75257]:         <nova:project uuid="cba8690ce4d3409194d26c988e0c4c51">tempest-VolumesActionsTest-1429079730</nova:project>
Nov 14 02:15:51 user nova-compute[75257]:       </nova:owner>
Nov 14 02:15:51 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:15:51 user nova-compute[75257]:       <nova:ports>
Nov 14 02:15:51 user nova-compute[75257]:         <nova:port uuid="3dd03a0a-a809-4e30-ac46-c9beb40caa25">
Nov 14 02:15:51 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 02:15:51 user nova-compute[75257]:         </nova:port>
Nov 14 02:15:51 user nova-compute[75257]:       </nova:ports>
Nov 14 02:15:51 user nova-compute[75257]:     </nova:instance>
Nov 14 02:15:51 user nova-compute[75257]:   </metadata>
Nov 14 02:15:51 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:15:51 user nova-compute[75257]:     <system>
Nov 14 02:15:51 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:15:51 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:15:51 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:15:51 user nova-compute[75257]:       <entry name="serial">4dc3f756-22cd-49c9-bd6e-643c69474512</entry>
Nov 14 02:15:51 user nova-compute[75257]:       <entry name="uuid">4dc3f756-22cd-49c9-bd6e-643c69474512</entry>
Nov 14 02:15:51 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:15:51 user nova-compute[75257]:     </system>
Nov 14 02:15:51 user nova-compute[75257]:   </sysinfo>
Nov 14 02:15:51 user nova-compute[75257]:   <os>
Nov 14 02:15:51 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:15:51 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:15:51 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:15:51 user nova-compute[75257]:   </os>
Nov 14 02:15:51 user nova-compute[75257]:   <features>
Nov 14 02:15:51 user nova-compute[75257]:     <acpi/>
Nov 14 02:15:51 user nova-compute[75257]:     <apic/>
Nov 14 02:15:51 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:15:51 user nova-compute[75257]:   </features>
Nov 14 02:15:51 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:15:51 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:15:51 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:15:51 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:15:51 user nova-compute[75257]:   </clock>
Nov 14 02:15:51 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:15:51 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:15:51 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:15:51 user nova-compute[75257]:   </cpu>
Nov 14 02:15:51 user nova-compute[75257]:   <devices>
Nov 14 02:15:51 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:15:51 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:15:51 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk"/>
Nov 14 02:15:51 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:15:51 user nova-compute[75257]:     </disk>
Nov 14 02:15:51 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:15:51 user nova-compute[75257]:       <mac address="fa:16:3e:0d:d1:fe"/>
Nov 14 02:15:51 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:51 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:15:51 user nova-compute[75257]:       <target dev="tap3dd03a0a-a8"/>
Nov 14 02:15:51 user nova-compute[75257]:     </interface>
Nov 14 02:15:51 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:15:51 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/console.log" append="off"/>
Nov 14 02:15:51 user nova-compute[75257]:     </serial>
Nov 14 02:15:51 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:15:51 user nova-compute[75257]:     <video>
Nov 14 02:15:51 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:15:51 user nova-compute[75257]:     </video>
Nov 14 02:15:51 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:15:51 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:15:51 user nova-compute[75257]:     </rng>
Nov 14 02:15:51 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:15:51 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:15:51 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:15:51 user nova-compute[75257]:     </memballoon>
Nov 14 02:15:51 user nova-compute[75257]:   </devices>
Nov 14 02:15:51 user nova-compute[75257]: </domain>
Nov 14 02:15:51 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-580478083',display_name='tempest-VolumesActionsTest-instance-580478083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-580478083',id=26,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cba8690ce4d3409194d26c988e0c4c51',ramdisk_id='',reservation_id='r-qazy63z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1429079730',owner_user_name='tempest-VolumesActionsTest-1429079730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:15:49Z,user_data=None,user_id='2bcdcb5c382f4e98bcfeb519efe7256b',uuid=4dc3f756-22cd-49c9-bd6e-643c69474512,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Converting VIF {"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d1:fe,bridge_name='br-int',has_traffic_filtering=True,id=3dd03a0a-a809-4e30-ac46-c9beb40caa25,network=Network(b1575ac8-6126-46b4-9240-a390b02b1e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd03a0a-a8') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG os_vif [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d1:fe,bridge_name='br-int',has_traffic_filtering=True,id=3dd03a0a-a809-4e30-ac46-c9beb40caa25,network=Network(b1575ac8-6126-46b4-9240-a390b02b1e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd03a0a-a8') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c65f3ec7-d601-5949-8944-985b385f79d9', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dd03a0a-a8, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dd03a0a-a8, col_values=(('qos', UUID('46aca4cf-2c42-441c-8720-8344307625d5')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dd03a0a-a8, col_values=(('external_ids', {'iface-id': '3dd03a0a-a809-4e30-ac46-c9beb40caa25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:d1:fe', 'vm-uuid': '4dc3f756-22cd-49c9-bd6e-643c69474512'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:51 user nova-compute[75257]: INFO os_vif [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d1:fe,bridge_name='br-int',has_traffic_filtering=True,id=3dd03a0a-a809-4e30-ac46-c9beb40caa25,network=Network(b1575ac8-6126-46b4-9240-a390b02b1e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd03a0a-a8')
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] No VIF found with MAC fa:16:3e:0d:d1:fe, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Updated VIF entry in instance network info cache for port 3dd03a0a-a809-4e30-ac46-c9beb40caa25. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Updating instance_info_cache with network_info: [{"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-373a7e90-e480-4713-a04b-a47cb5601d01 req-4266f6b3-44a2-4040-bd5d-f30c35f910af service nova] Releasing lock "refresh_cache-4dc3f756-22cd-49c9-bd6e-643c69474512" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received event network-vif-plugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] Acquiring lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] No waiting events found dispatching network-vif-plugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:53 user nova-compute[75257]: WARNING nova.compute.manager [req-1a52830c-4c0a-43b4-a35f-6e368e06f6e9 req-a8db90a3-b7f3-4ccf-8afd-fb9c1fb9f946 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received unexpected event network-vif-plugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance with vm_state building and task_state spawning.
Nov 14 02:15:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:15:54 user nova-compute[75257]: DEBUG nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:15:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:15:54 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Instance spawned successfully.
Nov 14 02:15:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:15:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:15:55 user nova-compute[75257]: INFO nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 14 02:15:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:15:55 user nova-compute[75257]: INFO nova.compute.manager [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Took 6.20 seconds to build instance.
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9755ff7a-82b4-49db-b784-9e4940b59526 tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.291s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:55 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b is timed out.
Nov 14 02:15:55 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully detached device vdb from instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b from the live domain config.
Nov 14 02:15:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECTNMDQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:15:55 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c708fde-a0ea-47b5-b39c-87d937a9f612]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:15:55 user nova-compute[75257]: No targets found.
Nov 14 02:15:55 user nova-compute[75257]: iSNS:
Nov 14 02:15:55 user nova-compute[75257]: No targets found.
Nov 14 02:15:55 user nova-compute[75257]: STATIC:
Nov 14 02:15:55 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22
Nov 14 02:15:55 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:55 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:55 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082
Nov 14 02:15:55 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:55 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:55 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a
Nov 14 02:15:55 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:55 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:55 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305
Nov 14 02:15:55 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:55 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:55 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:15:55 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:55 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:55 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d
Nov 14 02:15:55 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:15:55 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:15:55 user nova-compute[75257]: FIRMWARE:
Nov 14 02:15:55 user nova-compute[75257]: No targets found.
Nov 14 02:15:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:15:55 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:15:55 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5572487-2fd1-4018-bb9d-f1e3be9d20cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25a6236-03ad-402d-bfde-e448b1bdef5d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:15:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:15:55 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:15:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c2da290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c05c1-1349-4355-85fa-b1ce073f1d2e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[86557f40-deaf-460f-9a6f-74305f2cc448]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b55cfc-3bf0-4e7a-8919-f43defeee472]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac7edc4-c2b8-40de-b8f0-b2ad3a8799dc]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[36726e7d-0096-41cb-9658-4e5491a13afd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d316e4eb-54f2-4507-bc62-8f8d2b45464d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260]
Nov 14 02:15:55 user nova-compute[75257]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082, portal: 172.16.0.220,3260] successful.
Nov 14 02:15:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ae6554c-749e-436f-b233-36c7d3784082 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce200b82-7b7c-4fa1-9c4e-aebe0fa1e2cc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] <== disconnect_volume: return (332ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received event network-vif-plugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] Acquiring lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] No waiting events found dispatching network-vif-plugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:15:55 user nova-compute[75257]: WARNING nova.compute.manager [req-5fede2e9-f9a0-4a14-9790-c8cdc0b7d325 req-42e8cce6-1fc5-47cb-b775-a686c28d8155 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received unexpected event network-vif-plugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance with vm_state active and task_state None.
Nov 14 02:15:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:56 user nova-compute[75257]: DEBUG nova.objects.instance [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'flavor' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:15:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af1f8435-0d6d-4e53-a219-5c030cd6fd72 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:56 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:15:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:15:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:15:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:15:56 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:15:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updating instance_info_cache with network_info: [{"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:15:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:00 user nova-compute[75257]: INFO nova.compute.manager [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] instance snapshotting
Nov 14 02:16:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Beginning live snapshot process
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json -f qcow2 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:16:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json -f qcow2" returned: 0 in 0.526s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json -f qcow2 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:01 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:16:01 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7410MB free_disk=25.30819320678711GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance c226a1bf-4b89-49e0-ad8f-149849f12639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 4dc3f756-22cd-49c9-bd6e-643c69474512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_xf0e1o4/912e85bec74e49b2a57c09c235283456.delta 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_xf0e1o4/912e85bec74e49b2a57c09c235283456.delta 1073741824" returned: 0 in 0.050s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:01 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 02:16:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:16:01 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:16:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:16:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:16:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:16:03 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 02:16:03 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:16:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_xf0e1o4/912e85bec74e49b2a57c09c235283456.delta /opt/stack/data/nova/instances/snapshots/tmp_xf0e1o4/912e85bec74e49b2a57c09c235283456 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_xf0e1o4/912e85bec74e49b2a57c09c235283456.delta /opt/stack/data/nova/instances/snapshots/tmp_xf0e1o4/912e85bec74e49b2a57c09c235283456" returned: 0 in 0.501s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:03 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Snapshot extracted, beginning image upload
Nov 14 02:16:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:05 user nova-compute[75257]: INFO nova.compute.manager [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Rescuing
Nov 14 02:16:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquired lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:16:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Snapshot image upload complete
Nov 14 02:16:06 user nova-compute[75257]: INFO nova.compute.manager [None req-cb1dabe8-4ea5-4c8c-bb13-ad9ab3a669ad tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Took 5.55 seconds to snapshot the instance on the hypervisor.
Nov 14 02:16:06 user nova-compute[75257]: DEBUG nova.network.neutron [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updating instance_info_cache with network_info: [{"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Releasing lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-unplugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-unplugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:06 user nova-compute[75257]: WARNING nova.compute.manager [req-83129a81-4b2a-416f-9ebd-ef03911d5e3b req-de084524-f332-4101-9b11-b8e5f97888d7 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-unplugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state active and task_state rescuing.
Nov 14 02:16:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Instance destroyed successfully.
Nov 14 02:16:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Attempting a stable device rescue
Nov 14 02:16:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75257) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 02:16:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Instance directory exists: not creating {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 02:16:07 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Creating image(s)
Nov 14 02:16:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "/opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "/opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'trusted_certs' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "38848b412b91d7deae65738c5fae7b5faeeaec33" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "38848b412b91d7deae65738c5fae7b5faeeaec33" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.images [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] fc3a88bd-8950-489a-aefa-a7d1fe78e7b1 was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33.part /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33.part /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33.converted" returned: 0 in 0.235s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "38848b412b91d7deae65738c5fae7b5faeeaec33" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.649s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "38848b412b91d7deae65738c5fae7b5faeeaec33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "38848b412b91d7deae65738c5fae7b5faeeaec33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:16:08 user nova-compute[75257]: INFO nova.compute.claims [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Claim successful on node user
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:08 user nova-compute[75257]: WARNING nova.compute.manager [req-02189d05-ea2e-45c1-a3dc-6811492e95f1 req-1b09564b-cd7d-4b85-86a3-acbdbb21c0f7 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state active and task_state rescuing.
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33 --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33,backing_fmt=raw /opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.rescue {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33,backing_fmt=raw /opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.rescue" returned: 0 in 0.048s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "38848b412b91d7deae65738c5fae7b5faeeaec33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'migration_context' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.objects.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<ab639b27-9978-41c7-b93d-e18bd4af09d7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Start _get_guest_xml network_info=[{"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "vif_mac": "fa:16:3e:5c:f6:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fc3a88bd-8950-489a-aefa-a7d1fe78e7b1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fe691954-5790-4c23-8b23-ad72994a29b4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTuxVNGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'ab639b27-9978-41c7-b93d-e18bd4af09d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef89d81b-e5bf-41ab-a543-9a59db55976d', 'serial': 'ef89d81b-e5bf-41ab-a543-9a59db55976d'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'resources' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.objects.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<ab639b27-9978-41c7-b93d-e18bd4af09d7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'numa_topology' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.objects.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<ab639b27-9978-41c7-b93d-e18bd4af09d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:16:08 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:16:08 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'vcpu_model' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:08 user nova-compute[75257]: DEBUG nova.objects.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<ab639b27-9978-41c7-b93d-e18bd4af09d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTuxVNGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:16:09 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:16:09 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:16:09 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c26784-968e-48d3-96cd-6542d4be8ccf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kTuxVNGw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 02:16:09 user nova-compute[75257]: node.name = iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:16:09 user nova-compute[75257]: node.tpgt = -1
Nov 14 02:16:09 user nova-compute[75257]: node.startup = automatic
Nov 14 02:16:09 user nova-compute[75257]: node.leading_login = No
Nov 14 02:16:09 user nova-compute[75257]: iface.iscsi_ifacename = default
Nov 14 02:16:09 user nova-compute[75257]: iface.net_ifacename = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.ipaddress = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.prefix_len = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.hwaddress = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.transport_name = tcp
Nov 14 02:16:09 user nova-compute[75257]: iface.initiatorname = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.state = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.vlan_id = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.vlan_priority = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.vlan_state = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.iface_num = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.mtu = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.port = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.bootproto = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.subnet_mask = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.gateway = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.dhcp_alt_client_id = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.dhcp_dns = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.dhcp_learn_iqn = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.dhcp_vendor_id_state = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.dhcp_vendor_id = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.dhcp_slp_da = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.fragmentation = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.gratuitous_arp = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.incoming_forwarding = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.tos_state = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.tos = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.ttl = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.delayed_ack = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.tcp_nagle = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.tcp_wsf_state = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.tcp_wsf = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.tcp_timer_scale = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.tcp_timestamp = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.redirect = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.def_task_mgmt_timeout = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.header_digest = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.data_digest = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.immediate_data = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.initial_r2t = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.data_seq_inorder = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.data_pdu_inorder = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.erl = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.max_receive_data_len = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.first_burst_len = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.max_outstanding_r2t = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.max_burst_len = 0
Nov 14 02:16:09 user nova-compute[75257]: iface.chap_auth = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.bidi_chap = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.strict_login_compliance = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.discovery_auth = <empty>
Nov 14 02:16:09 user nova-compute[75257]: iface.discovery_logout = <empty>
Nov 14 02:16:09 user nova-compute[75257]: node.discovery_address = <empty>
Nov 14 02:16:09 user nova-compute[75257]: node.discovery_port = 0
Nov 14 02:16:09 user nova-compute[75257]: node.discovery_type = static
Nov 14 02:16:09 user nova-compute[75257]: node.session.initial_cmdsn = 0
Nov 14 02:16:09 user nova-compute[75257]: node.session.initial_login_retry_max = 8
Nov 14 02:16:09 user nova-compute[75257]: node.session.xmit_thread_priority = -20
Nov 14 02:16:09 user nova-compute[75257]: node.session.cmds_max = 128
Nov 14 02:16:09 user nova-compute[75257]: node.session.queue_depth = 32
Nov 14 02:16:09 user nova-compute[75257]: node.session.nr_sessions = 1
Nov 14 02:16:09 user nova-compute[75257]: node.session.auth.authmethod = CHAP
Nov 14 02:16:09 user nova-compute[75257]: node.session.auth.username = kTuxVNGw
Nov 14 02:16:09 user nova-compute[75257]: node.session.auth.password = ***
Nov 14 02:16:09 user nova-compute[75257]: node.session.auth.username_in = <empty>
Nov 14 02:16:09 user nova-compute[75257]: node.session.auth.password_in = <empty>
Nov 14 02:16:09 user nova-compute[75257]: node.session.auth.chap_algs = MD5
Nov 14 02:16:09 user nova-compute[75257]: node.session.timeo.replacement_timeout = 120
Nov 14 02:16:09 user nova-compute[75257]: node.session.err_timeo.abort_timeout = 15
Nov 14 02:16:09 user nova-compute[75257]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 02:16:09 user nova-compute[75257]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 02:16:09 user nova-compute[75257]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.FastAbort = Yes
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.InitialR2T = No
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.ImmediateData = Yes
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.MaxConnections = 1
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 02:16:09 user nova-compute[75257]: node.session.iscsi.ERL = 0
Nov 14 02:16:09 user nova-compute[75257]: node.session.scan = manual
Nov 14 02:16:09 user nova-compute[75257]: node.session.reopen_max = 0
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].address = 172.16.0.220
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].port = 3260
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].startup = manual
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].tcp.window_size = 524288
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].tcp.type_of_service = 0
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].timeo.logout_timeout = 15
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].timeo.login_timeout = 15
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].timeo.auth_timeout = 45
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].iscsi.DataDigest = None
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].iscsi.IFMarker = No
Nov 14 02:16:09 user nova-compute[75257]: node.conn[0].iscsi.OFMarker = No
Nov 14 02:16:09 user nova-compute[75257]: # END RECORD
Nov 14 02:16:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f133a9-c181-4f2a-be17-38ddd9750680]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3b88d6-2d80-4fef-a0b6-3fce7f2f2260]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kTuxVNGw {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kTuxVNGw" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1f3f00-47dc-4dda-a857-97926b8e4d49]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kTuxVNGw'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[df59726e-6684-440e-9f4c-c8beee5d0064]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4965ffb5-dd14-40f0-820c-5934d54acb71]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:09 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:16:09 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:16:09 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:16:09 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:09 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:16:09 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:16:09 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:16:09 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] HCTL ('35', '0', '0', 0) found on session 27 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c92077-ea5e-4176-9262-04472679aec3]: (4, ('0 0 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching for a device in session 27 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTuxVNGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23061653630623666', 'path': '/dev/sdd'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061653630623666', 'path': '/dev/sdd'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1905828341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1905828341',id=23,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:14:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-iv0rdupj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:14:32Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=ab639b27-9978-41c7-b93d-e18bd4af09d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "vif_mac": "fa:16:3e:5c:f6:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "vif_mac": "fa:16:3e:5c:f6:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:f6:3b,bridge_name='br-int',has_traffic_filtering=True,id=88e98b9f-7f03-4af9-a6a6-e512673f84ae,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e98b9f-7f') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'pci_devices' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.objects.base [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<ab639b27-9978-41c7-b93d-e18bd4af09d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:16:09 user nova-compute[75257]:   <uuid>ab639b27-9978-41c7-b93d-e18bd4af09d7</uuid>
Nov 14 02:16:09 user nova-compute[75257]:   <name>instance-00000017</name>
Nov 14 02:16:09 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:16:09 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:16:09 user nova-compute[75257]:   <metadata>
Nov 14 02:16:09 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:16:09 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:16:09 user nova-compute[75257]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1905828341</nova:name>
Nov 14 02:16:09 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:16:08</nova:creationTime>
Nov 14 02:16:09 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:16:09 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:16:09 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:16:09 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:16:09 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:16:09 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:16:09 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:16:09 user nova-compute[75257]:       <nova:owner>
Nov 14 02:16:09 user nova-compute[75257]:         <nova:user uuid="addcfdac50de4b03bd3ad3142508edea">tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member</nova:user>
Nov 14 02:16:09 user nova-compute[75257]:         <nova:project uuid="ac29176de8fc434285721bbb6759966d">tempest-ServerBootFromVolumeStableRescueTest-1355021813</nova:project>
Nov 14 02:16:09 user nova-compute[75257]:       </nova:owner>
Nov 14 02:16:09 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:16:09 user nova-compute[75257]:       <nova:ports>
Nov 14 02:16:09 user nova-compute[75257]:         <nova:port uuid="88e98b9f-7f03-4af9-a6a6-e512673f84ae">
Nov 14 02:16:09 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 02:16:09 user nova-compute[75257]:         </nova:port>
Nov 14 02:16:09 user nova-compute[75257]:       </nova:ports>
Nov 14 02:16:09 user nova-compute[75257]:     </nova:instance>
Nov 14 02:16:09 user nova-compute[75257]:   </metadata>
Nov 14 02:16:09 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:16:09 user nova-compute[75257]:     <system>
Nov 14 02:16:09 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:16:09 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:16:09 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:16:09 user nova-compute[75257]:       <entry name="serial">ab639b27-9978-41c7-b93d-e18bd4af09d7</entry>
Nov 14 02:16:09 user nova-compute[75257]:       <entry name="uuid">ab639b27-9978-41c7-b93d-e18bd4af09d7</entry>
Nov 14 02:16:09 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:16:09 user nova-compute[75257]:     </system>
Nov 14 02:16:09 user nova-compute[75257]:   </sysinfo>
Nov 14 02:16:09 user nova-compute[75257]:   <os>
Nov 14 02:16:09 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:16:09 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:16:09 user nova-compute[75257]:   </os>
Nov 14 02:16:09 user nova-compute[75257]:   <features>
Nov 14 02:16:09 user nova-compute[75257]:     <acpi/>
Nov 14 02:16:09 user nova-compute[75257]:     <apic/>
Nov 14 02:16:09 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:16:09 user nova-compute[75257]:   </features>
Nov 14 02:16:09 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:16:09 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:16:09 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:16:09 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:16:09 user nova-compute[75257]:   </clock>
Nov 14 02:16:09 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:16:09 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:16:09 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:16:09 user nova-compute[75257]:   </cpu>
Nov 14 02:16:09 user nova-compute[75257]:   <devices>
Nov 14 02:16:09 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:16:09 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:16:09 user nova-compute[75257]:       <source dev="/dev/sdd"/>
Nov 14 02:16:09 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:16:09 user nova-compute[75257]:       <serial>ef89d81b-e5bf-41ab-a543-9a59db55976d</serial>
Nov 14 02:16:09 user nova-compute[75257]:     </disk>
Nov 14 02:16:09 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:16:09 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:16:09 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.rescue"/>
Nov 14 02:16:09 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:16:09 user nova-compute[75257]:       <boot order="1"/>
Nov 14 02:16:09 user nova-compute[75257]:     </disk>
Nov 14 02:16:09 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:16:09 user nova-compute[75257]:       <mac address="fa:16:3e:5c:f6:3b"/>
Nov 14 02:16:09 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:16:09 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:16:09 user nova-compute[75257]:       <target dev="tap88e98b9f-7f"/>
Nov 14 02:16:09 user nova-compute[75257]:     </interface>
Nov 14 02:16:09 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:16:09 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/console.log" append="off"/>
Nov 14 02:16:09 user nova-compute[75257]:     </serial>
Nov 14 02:16:09 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:16:09 user nova-compute[75257]:     <video>
Nov 14 02:16:09 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:16:09 user nova-compute[75257]:     </video>
Nov 14 02:16:09 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:16:09 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:16:09 user nova-compute[75257]:     </rng>
Nov 14 02:16:09 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:16:09 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:16:09 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:16:09 user nova-compute[75257]:     </memballoon>
Nov 14 02:16:09 user nova-compute[75257]:   </devices>
Nov 14 02:16:09 user nova-compute[75257]: </domain>
Nov 14 02:16:09 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:16:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Instance destroyed successfully.
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No VIF found with MAC fa:16:3e:5c:f6:3b, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.network.neutron [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:16:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.policy [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '089b000c028b46b998f2c128a6cf3d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfae642569847a2a3ac4cd4066aeb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:16:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Creating image(s)
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "/opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "/opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "376aa244a68ca860f6ec663a4ad5548892ac1951" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "376aa244a68ca860f6ec663a4ad5548892ac1951" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Successfully created port: 826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG nova.virt.images [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 083a0fe3-040d-45de-871d-f50781bb7cab was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951.part /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:10 user nova-compute[75257]: WARNING nova.compute.manager [req-08b0bf41-6265-4382-a1f8-5c8121eda068 req-483c748f-3be8-416a-aa2e-06a8abc854ac service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state active and task_state rescuing.
Nov 14 02:16:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951.part /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951.converted" returned: 0 in 0.361s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "376aa244a68ca860f6ec663a4ad5548892ac1951" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.641s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Successfully updated port: 826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.compute.manager [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received event network-changed-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.compute.manager [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Refreshing instance network info cache due to event network-changed-826a1529-1134-4ec2-bf5e-bc15f0af1f75. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] Acquiring lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] Acquired lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Refreshing network info cache for port 826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951 --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "376aa244a68ca860f6ec663a4ad5548892ac1951" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "376aa244a68ca860f6ec663a4ad5548892ac1951" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b8e25d58-2287-4e7a-8b43-40307c4de185 req-421077e8-9b13-462f-98c3-1af627eff6d5 service nova] Releasing lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquired lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951 --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951,backing_fmt=raw /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951,backing_fmt=raw /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk 1073741824" returned: 0 in 0.055s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "376aa244a68ca860f6ec663a4ad5548892ac1951" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951 --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Ensure instance console log exists: /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Updating instance_info_cache with network_info: [{"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Releasing lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Instance network_info: |[{"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Start _get_guest_xml network_info=[{"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a4a6d9ae2eaa4a7a4801221f6a6288a2',container_format='bare',created_at=2023-11-14T02:16:00Z,direct_url=<?>,disk_format='qcow2',id=083a0fe3-040d-45de-871d-f50781bb7cab,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-743354389',owner='fbfae642569847a2a3ac4cd4066aeb22',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T02:16:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '083a0fe3-040d-45de-871d-f50781bb7cab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:16:11 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:16:11 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a4a6d9ae2eaa4a7a4801221f6a6288a2',container_format='bare',created_at=2023-11-14T02:16:00Z,direct_url=<?>,disk_format='qcow2',id=083a0fe3-040d-45de-871d-f50781bb7cab,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-743354389',owner='fbfae642569847a2a3ac4cd4066aeb22',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T02:16:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-707905753',display_name='tempest-TestStampPattern-server-707905753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-707905753',id=27,image_ref='083a0fe3-040d-45de-871d-f50781bb7cab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA29cl1fr1mQddCmz0NjRlHZtGI31Z/HpB+Nsx3OGKzEmi6USs0zIOlWO+VML9vORCyVCO+2Wn/r9l3Z21RvN0BLUGIBRfBmYCbzP7P30tWvVkVZygqVIesWMX0qe0GeCw==',key_name='tempest-TestStampPattern-863039138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbfae642569847a2a3ac4cd4066aeb22',ramdisk_id='',reservation_id='r-2oz142ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c226a1bf-4b89-49e0-ad8f-149849f12639',image_min_disk='1',image_min_ram='0',image_owner_id='fbfae642569847a2a3ac4cd4066aeb22',image_owner_project_name='tempest-TestStampPattern-1994748770',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1994748770-project-member',image_user_id='089b000c028b46b998f2c128a6cf3d0a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1994748770',owner_user_name='tempest-TestStampPattern-1994748770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:16:09Z,user_data=None,user_id='089b000c028b46b998f2c128a6cf3d0a',uuid=1bff6ecf-69c8-4940-8085-bb5f331ca91c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converting VIF {"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:25:62,bridge_name='br-int',has_traffic_filtering=True,id=826a1529-1134-4ec2-bf5e-bc15f0af1f75,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap826a1529-11') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.objects.instance [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bff6ecf-69c8-4940-8085-bb5f331ca91c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:16:11 user nova-compute[75257]:   <uuid>1bff6ecf-69c8-4940-8085-bb5f331ca91c</uuid>
Nov 14 02:16:11 user nova-compute[75257]:   <name>instance-0000001b</name>
Nov 14 02:16:11 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:16:11 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:16:11 user nova-compute[75257]:   <metadata>
Nov 14 02:16:11 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:16:11 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:16:11 user nova-compute[75257]:       <nova:name>tempest-TestStampPattern-server-707905753</nova:name>
Nov 14 02:16:11 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:16:11</nova:creationTime>
Nov 14 02:16:11 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:16:11 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:16:11 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:16:11 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:16:11 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:16:11 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:16:11 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:16:11 user nova-compute[75257]:       <nova:owner>
Nov 14 02:16:11 user nova-compute[75257]:         <nova:user uuid="089b000c028b46b998f2c128a6cf3d0a">tempest-TestStampPattern-1994748770-project-member</nova:user>
Nov 14 02:16:11 user nova-compute[75257]:         <nova:project uuid="fbfae642569847a2a3ac4cd4066aeb22">tempest-TestStampPattern-1994748770</nova:project>
Nov 14 02:16:11 user nova-compute[75257]:       </nova:owner>
Nov 14 02:16:11 user nova-compute[75257]:       <nova:root type="image" uuid="083a0fe3-040d-45de-871d-f50781bb7cab"/>
Nov 14 02:16:11 user nova-compute[75257]:       <nova:ports>
Nov 14 02:16:11 user nova-compute[75257]:         <nova:port uuid="826a1529-1134-4ec2-bf5e-bc15f0af1f75">
Nov 14 02:16:11 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 02:16:11 user nova-compute[75257]:         </nova:port>
Nov 14 02:16:11 user nova-compute[75257]:       </nova:ports>
Nov 14 02:16:11 user nova-compute[75257]:     </nova:instance>
Nov 14 02:16:11 user nova-compute[75257]:   </metadata>
Nov 14 02:16:11 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:16:11 user nova-compute[75257]:     <system>
Nov 14 02:16:11 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:16:11 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:16:11 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:16:11 user nova-compute[75257]:       <entry name="serial">1bff6ecf-69c8-4940-8085-bb5f331ca91c</entry>
Nov 14 02:16:11 user nova-compute[75257]:       <entry name="uuid">1bff6ecf-69c8-4940-8085-bb5f331ca91c</entry>
Nov 14 02:16:11 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:16:11 user nova-compute[75257]:     </system>
Nov 14 02:16:11 user nova-compute[75257]:   </sysinfo>
Nov 14 02:16:11 user nova-compute[75257]:   <os>
Nov 14 02:16:11 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:16:11 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:16:11 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:16:11 user nova-compute[75257]:   </os>
Nov 14 02:16:11 user nova-compute[75257]:   <features>
Nov 14 02:16:11 user nova-compute[75257]:     <acpi/>
Nov 14 02:16:11 user nova-compute[75257]:     <apic/>
Nov 14 02:16:11 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:16:11 user nova-compute[75257]:   </features>
Nov 14 02:16:11 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:16:11 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:16:11 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:16:11 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:16:11 user nova-compute[75257]:   </clock>
Nov 14 02:16:11 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:16:11 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:16:11 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:16:11 user nova-compute[75257]:   </cpu>
Nov 14 02:16:11 user nova-compute[75257]:   <devices>
Nov 14 02:16:11 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:16:11 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:16:11 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk"/>
Nov 14 02:16:11 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:16:11 user nova-compute[75257]:     </disk>
Nov 14 02:16:11 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:16:11 user nova-compute[75257]:       <mac address="fa:16:3e:ff:25:62"/>
Nov 14 02:16:11 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:16:11 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:16:11 user nova-compute[75257]:       <target dev="tap826a1529-11"/>
Nov 14 02:16:11 user nova-compute[75257]:     </interface>
Nov 14 02:16:11 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:16:11 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/console.log" append="off"/>
Nov 14 02:16:11 user nova-compute[75257]:     </serial>
Nov 14 02:16:11 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:16:11 user nova-compute[75257]:     <video>
Nov 14 02:16:11 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:16:11 user nova-compute[75257]:     </video>
Nov 14 02:16:11 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:16:11 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:16:11 user nova-compute[75257]:     </rng>
Nov 14 02:16:11 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:16:11 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:16:11 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:16:11 user nova-compute[75257]:     </memballoon>
Nov 14 02:16:11 user nova-compute[75257]:   </devices>
Nov 14 02:16:11 user nova-compute[75257]: </domain>
Nov 14 02:16:11 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-707905753',display_name='tempest-TestStampPattern-server-707905753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-707905753',id=27,image_ref='083a0fe3-040d-45de-871d-f50781bb7cab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA29cl1fr1mQddCmz0NjRlHZtGI31Z/HpB+Nsx3OGKzEmi6USs0zIOlWO+VML9vORCyVCO+2Wn/r9l3Z21RvN0BLUGIBRfBmYCbzP7P30tWvVkVZygqVIesWMX0qe0GeCw==',key_name='tempest-TestStampPattern-863039138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbfae642569847a2a3ac4cd4066aeb22',ramdisk_id='',reservation_id='r-2oz142ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c226a1bf-4b89-49e0-ad8f-149849f12639',image_min_disk='1',image_min_ram='0',image_owner_id='fbfae642569847a2a3ac4cd4066aeb22',image_owner_project_name='tempest-TestStampPattern-1994748770',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1994748770-project-member',image_user_id='089b000c028b46b998f2c128a6cf3d0a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1994748770',owner_user_name='tempest-TestStampPattern-1994748770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:16:09Z,user_data=None,user_id='089b000c028b46b998f2c128a6cf3d0a',uuid=1bff6ecf-69c8-4940-8085-bb5f331ca91c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converting VIF {"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:25:62,bridge_name='br-int',has_traffic_filtering=True,id=826a1529-1134-4ec2-bf5e-bc15f0af1f75,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap826a1529-11') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG os_vif [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:25:62,bridge_name='br-int',has_traffic_filtering=True,id=826a1529-1134-4ec2-bf5e-bc15f0af1f75,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap826a1529-11') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ab1d4a2-fed9-5330-999a-9f11184a6bfa', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap826a1529-11, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap826a1529-11, col_values=(('qos', UUID('3f55ec63-e015-40ee-a795-91dea3c4ee2f')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap826a1529-11, col_values=(('external_ids', {'iface-id': '826a1529-1134-4ec2-bf5e-bc15f0af1f75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:25:62', 'vm-uuid': '1bff6ecf-69c8-4940-8085-bb5f331ca91c'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:11 user nova-compute[75257]: INFO os_vif [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:25:62,bridge_name='br-int',has_traffic_filtering=True,id=826a1529-1134-4ec2-bf5e-bc15f0af1f75,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap826a1529-11')
Nov 14 02:16:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:16:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No VIF found with MAC fa:16:3e:ff:25:62, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:16:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-d0678bdc-fe44-4c9d-9283-924a801bc1c3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:16:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:12 user nova-compute[75257]: WARNING nova.compute.manager [req-42c84999-b66d-46a8-92c5-93bc99a18abb req-045dbe1d-cd21-4e12-ac6c-19d22fd48359 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state rescued and task_state None.
Nov 14 02:16:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received event network-vif-plugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] No waiting events found dispatching network-vif-plugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:15 user nova-compute[75257]: WARNING nova.compute.manager [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received unexpected event network-vif-plugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance with vm_state building and task_state spawning.
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received event network-vif-plugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] No waiting events found dispatching network-vif-plugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:15 user nova-compute[75257]: WARNING nova.compute.manager [req-88924279-4c98-4e91-bd77-0db4ca305188 req-29eea835-18ff-49cc-abe5-0753fbad93f8 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received unexpected event network-vif-plugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance with vm_state building and task_state spawning.
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:16:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Instance spawned successfully.
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:16:15 user nova-compute[75257]: INFO nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 14 02:16:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:16:15 user nova-compute[75257]: INFO nova.compute.manager [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Took 6.88 seconds to build instance.
Nov 14 02:16:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-653f2032-43e4-4cc1-b73f-556b1d19f632 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.052s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:27 user nova-compute[75257]: INFO nova.compute.manager [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Terminating instance
Nov 14 02:16:27 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-unplugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] No waiting events found dispatching network-vif-unplugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-4d177a67-854c-450f-b737-d5492cf4a98c req-ee2a2c79-c9ab-4879-8c15-67e85b5effad service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-unplugged-de607b68-f250-49c9-ac97-489a341f5963 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:16:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Instance destroyed successfully.
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'resources' on Instance uuid 2751bcd6-e958-4216-89f9-5e23f8b9dd9b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550486898',display_name='tempest-TestMinimumBasicScenario-server-550486898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550486898',id=18,image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCerez3qRud3tNAAT12b+t4i+0H7Sr5njhlCmhyMPjU2JaLT1djZUoYL1W2kD0Bsh7apkcxxkNW/Nd2lfcp9UJBVsonfsZCS9Q4VFC2iCaV+Xa1MxoJDOhjo3xsuwm5kw==',key_name='tempest-TestMinimumBasicScenario-1349261540',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cfe231fae1941f4970c17e344df8b81',ramdisk_id='',reservation_id='r-p0leackj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3add4d5a-2ef0-4ee1-aa15-5cd79ca04de7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1293674307',owner_user_name='tempest-TestMinimumBasicScenario-1293674307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:13:49Z,user_data=None,user_id='87f69eeadbaf45bfa01dfdfa5efcccb3',uuid=2751bcd6-e958-4216-89f9-5e23f8b9dd9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converting VIF {"id": "de607b68-f250-49c9-ac97-489a341f5963", "address": "fa:16:3e:d9:88:d1", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde607b68-f2", "ovs_interfaceid": "de607b68-f250-49c9-ac97-489a341f5963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG os_vif [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde607b68-f2, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33249690-ec71-45cc-a685-4a1c6bcbb7ec) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:28 user nova-compute[75257]: INFO os_vif [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:88:d1,bridge_name='br-int',has_traffic_filtering=True,id=de607b68-f250-49c9-ac97-489a341f5963,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde607b68-f2')
Nov 14 02:16:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Deleting instance files /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b_del
Nov 14 02:16:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Deletion of /opt/stack/data/nova/instances/2751bcd6-e958-4216-89f9-5e23f8b9dd9b_del complete
Nov 14 02:16:28 user nova-compute[75257]: INFO nova.compute.manager [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 02:16:28 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:28 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Took 0.44 seconds to deallocate network for instance.
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-45161529-dd6f-4799-a420-21f913505fad req-ba62cc1b-ed10-43b5-9f4c-e9fac929f614 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-deleted-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:16:28 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:16:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:29 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Deleted allocations for instance 2751bcd6-e958-4216-89f9-5e23f8b9dd9b
Nov 14 02:16:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1c7c0aa1-12bb-46a6-8379-cc795d456c89 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.853s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] Acquiring lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] Lock "2751bcd6-e958-4216-89f9-5e23f8b9dd9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] No waiting events found dispatching network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:29 user nova-compute[75257]: WARNING nova.compute.manager [req-2b908aa6-7c5c-46bd-84b3-e4b85a65d5d1 req-a7264b76-677f-4cc9-8103-223a683ae245 service nova] [instance: 2751bcd6-e958-4216-89f9-5e23f8b9dd9b] Received unexpected event network-vif-plugged-de607b68-f250-49c9-ac97-489a341f5963 for instance with vm_state deleted and task_state None.
Nov 14 02:16:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:16:39 user nova-compute[75257]: INFO nova.compute.claims [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Claim successful on node user
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.network.neutron [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:16:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.policy [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4002c20dcbc94a8ea540419f20f8621e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246dd4dc2106412bb0ca5e71670d9557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:16:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Creating image(s)
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "/opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "/opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "/opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk 1073741824" returned: 0 in 0.047s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.network.neutron [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Successfully created port: 8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Cannot resize image /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Ensure instance console log exists: /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.network.neutron [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Successfully updated port: 8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "refresh_cache-8487e985-c0d1-4bbd-9c28-c3312d737285" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquired lock "refresh_cache-8487e985-c0d1-4bbd-9c28-c3312d737285" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.network.neutron [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.compute.manager [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-changed-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.compute.manager [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Refreshing instance network info cache due to event network-changed-8ae70a55-08c9-43dd-9982-4f97e0b19ea2. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] Acquiring lock "refresh_cache-8487e985-c0d1-4bbd-9c28-c3312d737285" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:40 user nova-compute[75257]: DEBUG nova.network.neutron [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.network.neutron [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Updating instance_info_cache with network_info: [{"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Releasing lock "refresh_cache-8487e985-c0d1-4bbd-9c28-c3312d737285" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Instance network_info: |[{"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] Acquired lock "refresh_cache-8487e985-c0d1-4bbd-9c28-c3312d737285" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.network.neutron [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Refreshing network info cache for port 8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Start _get_guest_xml network_info=[{"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:16:41 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:16:41 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:16:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1593989199',display_name='tempest-AttachVolumeTestJSON-server-1593989199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1593989199',id=28,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hcSFq1FeMc+GFWewz+4DRO7u7cjYp28OdGpahF+Hv7z4eE0Gq7BOF5NGS5EG3kUCI/UqJLtdXnEI+nJsZqRsbH4dAS6d/Sj3fx3XI2oXIUZ5Y1xduDxKEsMyUiNoEIw==',key_name='tempest-keypair-2103484389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-h85ie8hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=8487e985-c0d1-4bbd-9c28-c3312d737285,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:02:34,bridge_name='br-int',has_traffic_filtering=True,id=8ae70a55-08c9-43dd-9982-4f97e0b19ea2,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae70a55-08') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'pci_devices' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:16:41 user nova-compute[75257]:   <uuid>8487e985-c0d1-4bbd-9c28-c3312d737285</uuid>
Nov 14 02:16:41 user nova-compute[75257]:   <name>instance-0000001c</name>
Nov 14 02:16:41 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:16:41 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:16:41 user nova-compute[75257]:   <metadata>
Nov 14 02:16:41 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:16:41 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:16:41 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeTestJSON-server-1593989199</nova:name>
Nov 14 02:16:41 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:16:41</nova:creationTime>
Nov 14 02:16:41 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:16:41 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:16:41 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:16:41 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:16:41 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:16:41 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:16:41 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:16:41 user nova-compute[75257]:       <nova:owner>
Nov 14 02:16:41 user nova-compute[75257]:         <nova:user uuid="4002c20dcbc94a8ea540419f20f8621e">tempest-AttachVolumeTestJSON-1670713184-project-member</nova:user>
Nov 14 02:16:41 user nova-compute[75257]:         <nova:project uuid="246dd4dc2106412bb0ca5e71670d9557">tempest-AttachVolumeTestJSON-1670713184</nova:project>
Nov 14 02:16:41 user nova-compute[75257]:       </nova:owner>
Nov 14 02:16:41 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:16:41 user nova-compute[75257]:       <nova:ports>
Nov 14 02:16:41 user nova-compute[75257]:         <nova:port uuid="8ae70a55-08c9-43dd-9982-4f97e0b19ea2">
Nov 14 02:16:41 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 02:16:41 user nova-compute[75257]:         </nova:port>
Nov 14 02:16:41 user nova-compute[75257]:       </nova:ports>
Nov 14 02:16:41 user nova-compute[75257]:     </nova:instance>
Nov 14 02:16:41 user nova-compute[75257]:   </metadata>
Nov 14 02:16:41 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:16:41 user nova-compute[75257]:     <system>
Nov 14 02:16:41 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:16:41 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:16:41 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:16:41 user nova-compute[75257]:       <entry name="serial">8487e985-c0d1-4bbd-9c28-c3312d737285</entry>
Nov 14 02:16:41 user nova-compute[75257]:       <entry name="uuid">8487e985-c0d1-4bbd-9c28-c3312d737285</entry>
Nov 14 02:16:41 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:16:41 user nova-compute[75257]:     </system>
Nov 14 02:16:41 user nova-compute[75257]:   </sysinfo>
Nov 14 02:16:41 user nova-compute[75257]:   <os>
Nov 14 02:16:41 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:16:41 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:16:41 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:16:41 user nova-compute[75257]:   </os>
Nov 14 02:16:41 user nova-compute[75257]:   <features>
Nov 14 02:16:41 user nova-compute[75257]:     <acpi/>
Nov 14 02:16:41 user nova-compute[75257]:     <apic/>
Nov 14 02:16:41 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:16:41 user nova-compute[75257]:   </features>
Nov 14 02:16:41 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:16:41 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:16:41 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:16:41 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:16:41 user nova-compute[75257]:   </clock>
Nov 14 02:16:41 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:16:41 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:16:41 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:16:41 user nova-compute[75257]:   </cpu>
Nov 14 02:16:41 user nova-compute[75257]:   <devices>
Nov 14 02:16:41 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:16:41 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:16:41 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk"/>
Nov 14 02:16:41 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:16:41 user nova-compute[75257]:     </disk>
Nov 14 02:16:41 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:16:41 user nova-compute[75257]:       <mac address="fa:16:3e:ce:02:34"/>
Nov 14 02:16:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:16:41 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:16:41 user nova-compute[75257]:       <target dev="tap8ae70a55-08"/>
Nov 14 02:16:41 user nova-compute[75257]:     </interface>
Nov 14 02:16:41 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:16:41 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/console.log" append="off"/>
Nov 14 02:16:41 user nova-compute[75257]:     </serial>
Nov 14 02:16:41 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:16:41 user nova-compute[75257]:     <video>
Nov 14 02:16:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:16:41 user nova-compute[75257]:     </video>
Nov 14 02:16:41 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:16:41 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:16:41 user nova-compute[75257]:     </rng>
Nov 14 02:16:41 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:16:41 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:16:41 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:16:41 user nova-compute[75257]:     </memballoon>
Nov 14 02:16:41 user nova-compute[75257]:   </devices>
Nov 14 02:16:41 user nova-compute[75257]: </domain>
Nov 14 02:16:41 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:16:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1593989199',display_name='tempest-AttachVolumeTestJSON-server-1593989199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1593989199',id=28,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hcSFq1FeMc+GFWewz+4DRO7u7cjYp28OdGpahF+Hv7z4eE0Gq7BOF5NGS5EG3kUCI/UqJLtdXnEI+nJsZqRsbH4dAS6d/Sj3fx3XI2oXIUZ5Y1xduDxKEsMyUiNoEIw==',key_name='tempest-keypair-2103484389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-h85ie8hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=8487e985-c0d1-4bbd-9c28-c3312d737285,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:02:34,bridge_name='br-int',has_traffic_filtering=True,id=8ae70a55-08c9-43dd-9982-4f97e0b19ea2,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae70a55-08') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG os_vif [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:02:34,bridge_name='br-int',has_traffic_filtering=True,id=8ae70a55-08c9-43dd-9982-4f97e0b19ea2,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae70a55-08') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27b38d63-343f-5bc1-861f-cf5b3555026f', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ae70a55-08, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ae70a55-08, col_values=(('qos', UUID('286a25c8-cf17-4e2e-bd92-765f6f4431ec')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ae70a55-08, col_values=(('external_ids', {'iface-id': '8ae70a55-08c9-43dd-9982-4f97e0b19ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:02:34', 'vm-uuid': '8487e985-c0d1-4bbd-9c28-c3312d737285'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:41 user nova-compute[75257]: INFO os_vif [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:02:34,bridge_name='br-int',has_traffic_filtering=True,id=8ae70a55-08c9-43dd-9982-4f97e0b19ea2,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae70a55-08')
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No VIF found with MAC fa:16:3e:ce:02:34, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:16:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-changed-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing instance network info cache due to event network-changed-531edd6a-d4a2-4d1a-a02d-e5efa760b394. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] Acquiring lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] Acquired lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG nova.network.neutron [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Refreshing network info cache for port 531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG nova.network.neutron [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Updated VIF entry in instance network info cache for port 8ae70a55-08c9-43dd-9982-4f97e0b19ea2. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG nova.network.neutron [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Updating instance_info_cache with network_info: [{"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-46bcb4f1-0693-4a63-a354-03f057dd4ce3 req-4a569f79-64b0-4838-9b6d-807fc07d47e2 service nova] Releasing lock "refresh_cache-8487e985-c0d1-4bbd-9c28-c3312d737285" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG nova.network.neutron [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updated VIF entry in instance network info cache for port 531edd6a-d4a2-4d1a-a02d-e5efa760b394. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG nova.network.neutron [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [{"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0b7f42ab-f209-4844-9422-b703f7dcb28c req-0038c71c-68d2-4b8d-b412-6039088e6828 service nova] Releasing lock "refresh_cache-54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] No waiting events found dispatching network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:43 user nova-compute[75257]: WARNING nova.compute.manager [req-1aa720f5-8958-46ff-960f-49170a75d946 req-530ce974-38ff-4e99-ae2d-797ca6d2dab6 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received unexpected event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance with vm_state building and task_state spawning.
Nov 14 02:16:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:44 user nova-compute[75257]: INFO nova.compute.manager [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Terminating instance
Nov 14 02:16:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lazy-loading 'flavor' on Instance uuid ce3a9680-3062-4e7d-8af3-81c31f3f499c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:44 user nova-compute[75257]: INFO nova.compute.manager [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Attaching volume b4786ccd-1c45-41bb-ae1d-76c3e036a112 to /dev/vdb
Nov 14 02:16:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-unplugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-6ad73239-df57-4a7b-a5f8-7a9e72a15a98 req-5011133e-8b3c-4cc3-987e-ba4c138795ac service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG os_brick.utils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be50f1d-e06e-4d39-b4ea-33fbc149c631]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[104eb467-3e1d-4494-a734-86d65007edac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ee6abc-e817-47b3-8890-68520eb1fa4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1e5410-8619-4290-b2b8-78b14bd7f598]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:16:45 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[da100f8a-e6dc-4499-b76e-391954e0ca4c]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG os_brick.utils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating existing volume attachment record: daae7c7b-7d54-45b3-a6f3-bea23aa8e0db {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] No waiting events found dispatching network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:45 user nova-compute[75257]: WARNING nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received unexpected event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance with vm_state building and task_state spawning.
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-unplugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:45 user nova-compute[75257]: WARNING nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-4c7870e4-5a12-40e6-a06c-e635347f66f5 for instance with vm_state active and task_state deleting.
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-unplugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b580de1-8988-4bdf-8f98-05b6c8941dbe req-2d09679e-30ee-4ada-b243-662782c6b00f service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:16:45 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Instance spawned successfully.
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-unplugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-ae635649-d61f-415d-8d72-18a5ca01c496 req-1337167e-0a8b-4c1d-afb4-bcd263cc2d8c service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:16:45 user nova-compute[75257]: INFO nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 14 02:16:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:16:45 user nova-compute[75257]: INFO nova.compute.manager [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Took 6.73 seconds to build instance.
Nov 14 02:16:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-07d57d6e-7582-4024-a3f9-161ddcdd12e7 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.841s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Instance destroyed successfully.
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lazy-loading 'resources' on Instance uuid 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:2e:f5,bridge_name='br-int',has_traffic_filtering=True,id=531edd6a-d4a2-4d1a-a02d-e5efa760b394,network=Network(f4b66683-d156-4859-8b77-bbcee566de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531edd6a-d4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:2e:f5,bridge_name='br-int',has_traffic_filtering=True,id=531edd6a-d4a2-4d1a-a02d-e5efa760b394,network=Network(f4b66683-d156-4859-8b77-bbcee566de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531edd6a-d4') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap531edd6a-d4, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a90726c-8c0d-4beb-9578-9575e061e737) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: INFO os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:2e:f5,bridge_name='br-int',has_traffic_filtering=True,id=531edd6a-d4a2-4d1a-a02d-e5efa760b394,network=Network(f4b66683-d156-4859-8b77-bbcee566de49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap531edd6a-d4')
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:45:58,bridge_name='br-int',has_traffic_filtering=True,id=f4ac726b-9912-4b5f-b751-3ca0a0621e09,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4ac726b-99') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:45:58,bridge_name='br-int',has_traffic_filtering=True,id=f4ac726b-9912-4b5f-b751-3ca0a0621e09,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4ac726b-99') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4ac726b-99, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f6c8700-e0f4-4997-aa27-f90699d28a25) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: INFO os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:45:58,bridge_name='br-int',has_traffic_filtering=True,id=f4ac726b-9912-4b5f-b751-3ca0a0621e09,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4ac726b-99')
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=4c7870e4-5a12-40e6-a06c-e635347f66f5,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c7870e4-5a') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=4c7870e4-5a12-40e6-a06c-e635347f66f5,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c7870e4-5a') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c7870e4-5a, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53fda5ca-b506-4992-87ec-82f8467899c6) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: INFO os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:bd:2f,bridge_name='br-int',has_traffic_filtering=True,id=4c7870e4-5a12-40e6-a06c-e635347f66f5,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c7870e4-5a')
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=f3041f35-502b-4bb9-9e73-13fe8aa11484,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3041f35-50') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=f3041f35-502b-4bb9-9e73-13fe8aa11484,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3041f35-50') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3041f35-50, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=588b8ee9-4a76-4e77-993a-21ddc55523e2) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: INFO os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:3d:ee,bridge_name='br-int',has_traffic_filtering=True,id=f3041f35-502b-4bb9-9e73-13fe8aa11484,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3041f35-50')
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:9f:b6,bridge_name='br-int',has_traffic_filtering=True,id=e3b64855-b03b-4ee1-8c89-6e3abc178faa,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3b64855-b0') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:9f:b6,bridge_name='br-int',has_traffic_filtering=True,id=e3b64855-b03b-4ee1-8c89-6e3abc178faa,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3b64855-b0') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3b64855-b0, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36bad62b-6011-4de0-931b-afcef4ef1d42) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: INFO os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:9f:b6,bridge_name='br-int',has_traffic_filtering=True,id=e3b64855-b03b-4ee1-8c89-6e3abc178faa,network=Network(ae0b74b3-6290-47c9-91d3-7c1a60fa5c78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3b64855-b0')
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "address": "fa:16:3e:8a:ea:bd", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf13dd1ab-e4", "ovs_interfaceid": "f13dd1ab-e475-40ad-a7d9-18d96362a10d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=f13dd1ab-e475-40ad-a7d9-18d96362a10d,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13dd1ab-e4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=f13dd1ab-e475-40ad-a7d9-18d96362a10d,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13dd1ab-e4') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf13dd1ab-e4, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e06af27-f76b-4f66-a40b-80d2d045a654) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: INFO os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=f13dd1ab-e475-40ad-a7d9-18d96362a10d,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf13dd1ab-e4')
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1744950715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1744950715',id=24,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS6DZP4Tyrj1d/Ri0bD0D1i8Uoi8UUfFD9L8UqyZQXoBfABmDBQ98ntL+lLnFdPgbAruZvpG0gHpWVMyq/u8foV+OJofg2iQKyQT8YA7Z+kduJBNOn8sLD7jxLfTxnjwg==',key_name='tempest-keypair-215674162',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e1d90f2eaae4b19883b23e8aaa8f47a',ramdisk_id='',reservation_id='r-085kh6sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-333319311',owner_user_name='tempest-TaggedBootDevicesTest-333319311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e82c04681c164b6fb997c0f97e9c77ec',uuid=54817bdb-e0cc-4168-bf4f-1e47e6fe7a88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converting VIF {"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=e2acc9ad-f868-4e07-83c4-b87a1f08e670,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2acc9ad-f8') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=e2acc9ad-f868-4e07-83c4-b87a1f08e670,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2acc9ad-f8') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2acc9ad-f8, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:46 user nova-compute[75257]: WARNING nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-531edd6a-d4a2-4d1a-a02d-e5efa760b394 for instance with vm_state active and task_state deleting.
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-unplugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:47 user nova-compute[75257]: WARNING nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-f4ac726b-9912-4b5f-b751-3ca0a0621e09 for instance with vm_state active and task_state deleting.
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-unplugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:47 user nova-compute[75257]: WARNING nova.compute.manager [req-1446001a-a365-42b3-863b-f0377781faee req-df40be28-9d99-4dc2-a1e5-22ce4cc9176a service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-e3b64855-b03b-4ee1-8c89-6e3abc178faa for instance with vm_state active and task_state deleting.
Nov 14 02:16:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ed7ef55-b55b-4643-a838-3161f333e227) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:47 user nova-compute[75257]: INFO os_vif [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a0:5e,bridge_name='br-int',has_traffic_filtering=True,id=e2acc9ad-f868-4e07-83c4-b87a1f08e670,network=Network(9bab567c-81ae-4eb6-b1d2-347bd1be854d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2acc9ad-f8')
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPNVIjbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:16:47 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebc060d-609f-4714-802c-11d37cb694d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:16:47 user nova-compute[75257]: No targets found.
Nov 14 02:16:47 user nova-compute[75257]: iSNS:
Nov 14 02:16:47 user nova-compute[75257]: No targets found.
Nov 14 02:16:47 user nova-compute[75257]: STATIC:
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: FIRMWARE:
Nov 14 02:16:47 user nova-compute[75257]: No targets found.
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:16:47 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:16:47 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ceadad-5f39-459c-948e-2051ae8751c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be5b0a0-0711-422d-a5b2-b7a1949dbd4e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3c95a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d'): ({'sde'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Removing single pathed devices sde {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b3c818-18a7-4eab-8b0d-d7a547e948f5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1a7e0-c0a2-4866-8590-57da10e7bc5b]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Flushing IO for device /dev/sde {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6b5889-c7c7-4cd8-a13c-061214c36ce2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d3944c-bd58-46a9-a7a7-cffa79a76802]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1371773e-3c24-4d0e-a2b9-54da1f308589]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaf8971-a326-453a-a633-24a5db11ef17]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d, portal: 172.16.0.220,3260]
Nov 14 02:16:47 user nova-compute[75257]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d, portal: 172.16.0.220,3260] successful.
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42dbd7d9-2083-4d89-be08-66361918c52d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4d9e0a-c820-4b48-abd0-901735336658]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] <== disconnect_volume: return (342ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdnyQhwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:16:47 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee39f7c-21f1-4c16-ad48-fd2c288e01ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:16:47 user nova-compute[75257]: No targets found.
Nov 14 02:16:47 user nova-compute[75257]: iSNS:
Nov 14 02:16:47 user nova-compute[75257]: No targets found.
Nov 14 02:16:47 user nova-compute[75257]: STATIC:
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: FIRMWARE:
Nov 14 02:16:47 user nova-compute[75257]: No targets found.
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:16:47 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:16:47 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[86655ad7-4d05-4d4a-97f9-e4a01e98ea49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66992976-5b6b-4058-9a64-bbe83c521144]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3c95a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22'): ({'sdf'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Removing single pathed devices sdf {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98b33ef-28bd-4187-926f-18eaa0300ec0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4def84d4-277b-492d-b8b2-aae1e208f3d8]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Flushing IO for device /dev/sdf {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[71486224-7f3a-4a3f-bad1-916814cf7388]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6830ffb-288f-4c38-b11e-3254507c7a9c]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:47 user nova-compute[75257]: WARNING nova.compute.manager [req-e3fc6a64-b252-4a0f-b8c7-40ee97f021e8 req-9b9366e5-711e-408f-b323-1d30d847c1b0 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-f3041f35-502b-4bb9-9e73-13fe8aa11484 for instance with vm_state active and task_state deleting.
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf8e80e-ed97-4d53-baf4-65f90c721916]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:47 user nova-compute[75257]: WARNING nova.compute.manager [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-f13dd1ab-e475-40ad-a7d9-18d96362a10d for instance with vm_state active and task_state deleting.
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-unplugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-unplugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-plugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Acquiring lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] No waiting events found dispatching network-vif-plugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:47 user nova-compute[75257]: WARNING nova.compute.manager [req-d1304380-a5f2-4ad2-a87d-aaa0f3dfa4a3 req-95a26047-d159-4c39-8cc9-d0a5336ee6c9 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received unexpected event network-vif-plugged-e2acc9ad-f868-4e07-83c4-b87a1f08e670 for instance with vm_state active and task_state deleting.
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b98d39a-a45f-4bdc-bcfd-f1675bfb4b24]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22, portal: 172.16.0.220,3260]
Nov 14 02:16:47 user nova-compute[75257]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22, portal: 172.16.0.220,3260] successful.
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dfc9d29-0d9c-406b-bc49-d31ed7396b22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec080ad9-8d6c-404c-9997-1c4183e48c2a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] <== disconnect_volume: return (324ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTVKriOR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:16:47 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f08581d-1b51-4b82-9893-09faffa0cbcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:16:47 user nova-compute[75257]: No targets found.
Nov 14 02:16:47 user nova-compute[75257]: iSNS:
Nov 14 02:16:47 user nova-compute[75257]: No targets found.
Nov 14 02:16:47 user nova-compute[75257]: STATIC:
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:16:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:47 user nova-compute[75257]: FIRMWARE:
Nov 14 02:16:47 user nova-compute[75257]: No targets found.
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:16:47 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:16:47 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[226050b1-b15e-4e13-8532-ed6b8ee0f542]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a56aa4-a8ee-4ada-8a25-0e475dd83f1a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a (non-flash)
Nov 14 02:16:47 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3c95a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a'): ({'sdg'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Removing single pathed devices sdg {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c997bd09-e626-40e6-93fe-e3112668caff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce687bcd-d069-477c-ad9c-3a3063c1ef57]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Flushing IO for device /dev/sdg {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bdca61-11b3-403b-bb02-0cd497cae098]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaedaad-3417-4496-a3e3-03147cd7a0cc]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] SCSI volumes sdg have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a841030d-ff87-4d25-8653-4b43a254326c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c062a40c-69f3-485a-851b-7b7cc77a67ee]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a, portal: 172.16.0.220,3260]
Nov 14 02:16:47 user nova-compute[75257]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a, portal: 172.16.0.220,3260] successful.
Nov 14 02:16:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b62c9e-80a8-43bc-b6ec-67fffaff059a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdfc20-60f4-4396-ba16-10c47e3de0e7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:16:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] <== disconnect_volume: return (310ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:16:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:16:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Deleting instance files /opt/stack/data/nova/instances/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88_del
Nov 14 02:16:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Deletion of /opt/stack/data/nova/instances/54817bdb-e0cc-4168-bf4f-1e47e6fe7a88_del complete
Nov 14 02:16:48 user nova-compute[75257]: INFO nova.compute.manager [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Took 3.72 seconds to destroy the instance on the hypervisor.
Nov 14 02:16:48 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:16:48 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:16:48 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-deleted-f13dd1ab-e475-40ad-a7d9-18d96362a10d {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:49 user nova-compute[75257]: INFO nova.compute.manager [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Neutron deleted interface f13dd1ab-e475-40ad-a7d9-18d96362a10d; detaching it from the instance and deleting it from the info cache
Nov 14 02:16:49 user nova-compute[75257]: DEBUG nova.network.neutron [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [{"id": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "address": "fa:16:3e:d9:2e:f5", "network": {"id": "f4b66683-d156-4859-8b77-bbcee566de49", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1813540256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap531edd6a-d4", "ovs_interfaceid": "531edd6a-d4a2-4d1a-a02d-e5efa760b394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "address": "fa:16:3e:29:45:58", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ac726b-99", "ovs_interfaceid": "f4ac726b-9912-4b5f-b751-3ca0a0621e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "address": "fa:16:3e:2d:bd:2f", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7870e4-5a", "ovs_interfaceid": "4c7870e4-5a12-40e6-a06c-e635347f66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "address": "fa:16:3e:54:3d:ee", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3041f35-50", "ovs_interfaceid": "f3041f35-502b-4bb9-9e73-13fe8aa11484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "address": "fa:16:3e:61:9f:b6", "network": {"id": "ae0b74b3-6290-47c9-91d3-7c1a60fa5c78", "bridge": "br-int", "label": "tempest-device-tagging-net1-138496285", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b64855-b0", "ovs_interfaceid": "e3b64855-b03b-4ee1-8c89-6e3abc178faa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "address": "fa:16:3e:61:a0:5e", "network": {"id": "9bab567c-81ae-4eb6-b1d2-347bd1be854d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1924630081", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9e1d90f2eaae4b19883b23e8aaa8f47a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2acc9ad-f8", "ovs_interfaceid": "e2acc9ad-f868-4e07-83c4-b87a1f08e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-6be235ff-3379-4d17-95c8-629877229ad4 req-26aff09c-bd8b-4b3a-8144-10bbf10b1481 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Detach interface failed, port_id=f13dd1ab-e475-40ad-a7d9-18d96362a10d, reason: Instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:16:49 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:16:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:16:49 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:16:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:16:49 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:16:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d923885-f82f-4cff-90fd-84944e128ab1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:16:49 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73838fea-9cb4-4202-a10a-b90df3fca51a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112] added
Nov 14 02:16:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bff13eb-411e-48e2-87cd-e7f2cfff5798]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a904e032-d60f-43aa-93b2-99e3a5e33ae5]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypbaiVoH {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypbaiVoH" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c304e16-855c-4a79-a174-ab6c80b2c00f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ypbaiVoH'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eda3e5f-ca5b-4001-8d92-f2522156b3a4]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9846727-82a0-4fb7-bc8f-9ddb7c9d1f1c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:50 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:50 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff29f1c-d6e1-4e95-a6b8-c118a0fc0c37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]
Nov 14 02:16:50 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.
Nov 14 02:16:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f347bab8-4aef-47ba-8784-80e92b4e5bcc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0818fd47-e4ca-4de4-ad64-831c514a2391]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:50 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:50 user nova-compute[75257]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:16:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:50 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:50 user nova-compute[75257]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:16:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9293a6ed-7a50-450f-8b2e-43ec051b471e]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:16:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26265383633336139', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265383633336139', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lazy-loading 'flavor' on Instance uuid ce3a9680-3062-4e7d-8af3-81c31f3f499c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:16:51 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:16:51 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:16:51 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:16:51 user nova-compute[75257]:   <serial>b4786ccd-1c45-41bb-ae1d-76c3e036a112</serial>
Nov 14 02:16:51 user nova-compute[75257]: </disk>
Nov 14 02:16:51 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:51 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Took 3.08 seconds to deallocate network for instance.
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] No VIF found with MAC fa:16:3e:40:6e:3c, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5c3fc362-07b0-4e51-b6ef-4cdcb87889b5 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.977s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-deleted-e3b64855-b03b-4ee1-8c89-6e3abc178faa {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-deleted-f3041f35-502b-4bb9-9e73-13fe8aa11484 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-deleted-e2acc9ad-f868-4e07-83c4-b87a1f08e670 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-2dc2a623-3d2e-4b79-b337-04fcdb373003 req-2dbccb0c-cd5c-4fc2-9ef4-e4bda2ecb789 service nova] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Received event network-vif-deleted-531edd6a-d4a2-4d1a-a02d-e5efa760b394 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:53 user nova-compute[75257]: INFO nova.compute.manager [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] [instance: 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88] Took 2.24 seconds to detach 3 volumes for instance.
Nov 14 02:16:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:16:54 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:16:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:54 user nova-compute[75257]: DEBUG nova.compute.manager [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Stashing vm_state: active {{(pid=75257) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 02:16:54 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Deleted allocations for instance 54817bdb-e0cc-4168-bf4f-1e47e6fe7a88
Nov 14 02:16:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e2ebb685-371f-4069-b222-42abd3c1114a tempest-TaggedBootDevicesTest-333319311 tempest-TaggedBootDevicesTest-333319311-project-member] Lock "54817bdb-e0cc-4168-bf4f-1e47e6fe7a88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.595s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:16:54 user nova-compute[75257]: INFO nova.compute.claims [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Claim successful on node user
Nov 14 02:16:54 user nova-compute[75257]: INFO nova.compute.resource_tracker [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating resource usage from migration 20581c3d-4128-40cb-bc8e-671d21b0f169
Nov 14 02:16:54 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:54 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:16:54 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.849s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:55 user nova-compute[75257]: INFO nova.compute.manager [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Migrating
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:55 user nova-compute[75257]: INFO nova.compute.rpcapi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquired lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG nova.network.neutron [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG nova.network.neutron [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating instance_info_cache with network_info: [{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Releasing lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Starting migrate_disk_and_power_off {{(pid=75257) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-unplugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-unplugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:55 user nova-compute[75257]: WARNING nova.compute.manager [req-3e6b44ef-57a7-459d-8f3d-b07fcbd6b132 req-46dfd488-de9c-4b64-b8ab-db3b5428a86a service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-unplugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state active and task_state resize_migrating.
Nov 14 02:16:56 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance destroyed successfully.
Nov 14 02:16:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-164252655',display_name='tempest-ServerActionsTestOtherB-server-164252655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-164252655',id=21,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA==',key_name='tempest-keypair-1362037621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5dcd87f632574f81813bc7606a8fe70e',ramdisk_id='',reservation_id='r-5x0q0qiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2069029360',owner_user_name='tempest-ServerActionsTestOtherB-2069029360-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73fe859f2604a1bbf70f01587cf015c',uuid=ce3a9680-3062-4e7d-8af3-81c31f3f499c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2074904170-network", "vif_mac": "fa:16:3e:40:6e:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converting VIF {"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2074904170-network", "vif_mac": "fa:16:3e:40:6e:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_vif [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped73d0a9-0d, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2a36b57-c94e-49fa-b985-e2643cfee451) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:56 user nova-compute[75257]: INFO os_vif [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d')
Nov 14 02:16:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:16:56 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca63833-a1e2-462e-a646-f5e6534c6c1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:16:56 user nova-compute[75257]: No targets found.
Nov 14 02:16:56 user nova-compute[75257]: iSNS:
Nov 14 02:16:56 user nova-compute[75257]: No targets found.
Nov 14 02:16:56 user nova-compute[75257]: STATIC:
Nov 14 02:16:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112
Nov 14 02:16:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305
Nov 14 02:16:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:16:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:56 user nova-compute[75257]: FIRMWARE:
Nov 14 02:16:56 user nova-compute[75257]: No targets found.
Nov 14 02:16:56 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:16:56 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:16:56 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d47fcf-cb5d-4332-88e9-e1c39437e0bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6440691-a773-4034-aeee-4bade648fe87]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:56 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:56 user nova-compute[75257]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:16:56 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:56 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:56 user nova-compute[75257]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:16:56 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c301e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[93899ff9-7a11-452d-9ed3-73376fb3de03]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d09e242-6ab7-4af2-a31e-1de7277c41ab]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7507dfb1-4829-43f5-a676-3684ef44bb0c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3030a051-9989-4121-b7d8-642bd2bc8d39]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b7ff1e-9262-45e0-819a-042bb17b7515]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e1e221-3407-46e8-88f3-ccecef40be5c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]
Nov 14 02:16:56 user nova-compute[75257]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.
Nov 14 02:16:56 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[99776b20-db4d-4f64-8bc3-450477f9ddf7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] <== disconnect_volume: return (281ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c_resize/disk /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "cp -r /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c_resize/disk /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk" returned: 0 in 0.258s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c_resize/disk.info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk.info {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "cp -r /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c_resize/disk.info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk.info" returned: 0 in 0.042s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:57 user nova-compute[75257]: INFO nova.compute.manager [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Terminating instance
Nov 14 02:16:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received event network-vif-unplugged-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] Acquiring lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] No waiting events found dispatching network-vif-unplugged-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-c7552083-0181-4c2f-8440-413601da779a req-d925b845-ca3a-4007-ba55-02ef1b3ca801 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received event network-vif-unplugged-03336681-82cb-4a6f-b9a2-f429ade55494 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:57 user nova-compute[75257]: WARNING nova.compute.manager [req-44133359-ecb0-4724-b911-b30dfae12536 req-42b49e5b-bd09-4425-9af0-e1955fcfce3b service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state active and task_state resize_migrating.
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updating instance_info_cache with network_info: [{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Instance destroyed successfully.
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.objects.instance [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'resources' on Instance uuid ad924c94-eeb6-40d0-87c6-b7bc3e19b36f {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1951903037',display_name='tempest-TestVolumeBootPattern-server-1951903037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1951903037',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:15:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-erfsi4db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:15:23Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=ad924c94-eeb6-40d0-87c6-b7bc3e19b36f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "03336681-82cb-4a6f-b9a2-f429ade55494", "address": "fa:16:3e:65:66:3a", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03336681-82", "ovs_interfaceid": "03336681-82cb-4a6f-b9a2-f429ade55494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:66:3a,bridge_name='br-int',has_traffic_filtering=True,id=03336681-82cb-4a6f-b9a2-f429ade55494,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03336681-82') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_vif [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:66:3a,bridge_name='br-int',has_traffic_filtering=True,id=03336681-82cb-4a6f-b9a2-f429ade55494,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03336681-82') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03336681-82, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=056f318e-49d7-442f-8ec2-90cc7f2934bc) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:16:58 user nova-compute[75257]: INFO os_vif [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:66:3a,bridge_name='br-int',has_traffic_filtering=True,id=03336681-82cb-4a6f-b9a2-f429ade55494,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03336681-82')
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqmcNwCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:16:58 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a451e95d-b4b1-4f32-a1df-15557b48eb27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:16:58 user nova-compute[75257]: No targets found.
Nov 14 02:16:58 user nova-compute[75257]: iSNS:
Nov 14 02:16:58 user nova-compute[75257]: No targets found.
Nov 14 02:16:58 user nova-compute[75257]: STATIC:
Nov 14 02:16:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305
Nov 14 02:16:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:16:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:16:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:16:58 user nova-compute[75257]: FIRMWARE:
Nov 14 02:16:58 user nova-compute[75257]: No targets found.
Nov 14 02:16:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:16:58 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:16:58 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[520fc5fd-e97b-4fa7-b557-054eb0268d8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8a1db7-6f52-4a07-9098-2d478bbf07e9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:58 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:16:58 user nova-compute[75257]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 (non-flash)
Nov 14 02:16:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c302b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305'): ({'sdh'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Removing single pathed devices sdh {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd701b88-f5bd-4d95-94ad-9d3893039228]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9217edb3-4c33-499a-bb43-a26f4b92194b]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flushing IO for device /dev/sdh {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf421f7-b4a3-4bdb-87cd-d0a2c5a2b292]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af98f687-285c-4dfb-a9bc-0523527b46f1]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Port ed73d0a9-0d24-470f-9fef-56c5474f0a9e binding to destination host user is already ACTIVE {{(pid=75257) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] SCSI volumes sdh have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80d5846-5f38-49f5-accf-5d16fe88f2ad]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d81dcd2-5a3a-41d1-ba27-ee4995e359ed]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305, portal: 172.16.0.220,3260]
Nov 14 02:16:58 user nova-compute[75257]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305, portal: 172.16.0.220,3260] successful.
Nov 14 02:16:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf3820a-42ce-4d67-91f9-d08b4813f305 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5183fa3-aa48-4e5d-bf1d-470d67b27d28]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== disconnect_volume: return (394ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:16:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Deleting instance files /opt/stack/data/nova/instances/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f_del
Nov 14 02:16:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Deletion of /opt/stack/data/nova/instances/ad924c94-eeb6-40d0-87c6-b7bc3e19b36f_del complete
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: INFO nova.compute.manager [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquired lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating instance_info_cache with network_info: [{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Releasing lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:59 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Took 1.03 seconds to deallocate network for instance.
Nov 14 02:16:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received event network-vif-plugged-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] Acquiring lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] No waiting events found dispatching network-vif-plugged-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:16:59 user nova-compute[75257]: WARNING nova.compute.manager [req-dba690e7-65ad-43a9-8843-2425b9dd3824 req-c2224da5-3a51-46aa-8163-6a6bba297f37 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received unexpected event network-vif-plugged-03336681-82cb-4a6f-b9a2-f429ade55494 for instance with vm_state active and task_state deleting.
Nov 14 02:16:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Received event network-vif-deleted-03336681-82cb-4a6f-b9a2-f429ade55494 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:16:59 user nova-compute[75257]: INFO nova.compute.manager [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Neutron deleted interface 03336681-82cb-4a6f-b9a2-f429ade55494; detaching it from the instance and deleting it from the info cache
Nov 14 02:16:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG os_brick.utils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-ef08b12b-602e-40b7-ad25-7306034b6474 req-b1063749-f1bf-4d04-82f5-8b3cedfe1b26 service nova] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Detach interface failed, port_id=03336681-82cb-4a6f-b9a2-f429ade55494, reason: Instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[46065b3f-2fb2-4a78-835d-966eb9715537]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e49034-3f34-44f5-9774-ecec244a4aad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c633b6d8-b59c-4aa3-a93a-96fc3bb78624]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[316400f9-8b80-4c42-959f-f2540aa8f2fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:16:59 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad42506-c552-4bf4-a94a-a1e76422c6ab]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG os_brick.utils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:16:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:00 user nova-compute[75257]: INFO nova.compute.manager [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 02:17:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: ad924c94-eeb6-40d0-87c6-b7bc3e19b36f] Deleting volume: edf3820a-42ce-4d67-91f9-d08b4813f305 {{(pid=75257) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.803s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:01 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Deleted allocations for instance ad924c94-eeb6-40d0-87c6-b7bc3e19b36f
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa1f85a8-8ae5-4c8a-abeb-cc88de802aa1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "ad924c94-eeb6-40d0-87c6-b7bc3e19b36f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.188s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:17:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Error from libvirt while getting description of instance-00000019: [Error Code 42] Domain not found: no domain with matching uuid 'ad924c94-eeb6-40d0-87c6-b7bc3e19b36f' (instance-00000019): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ad924c94-eeb6-40d0-87c6-b7bc3e19b36f' (instance-00000019)
Nov 14 02:17:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=25.03506088256836GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Applying migration context for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c as it has an incoming, in-progress migration 20581c3d-4128-40cb-bc8e-671d21b0f169. Migration status is post-migrating {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 02:17:03 user nova-compute[75257]: INFO nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating resource usage from migration 20581c3d-4128-40cb-bc8e-671d21b0f169
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance c226a1bf-4b89-49e0-ad8f-149849f12639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 4dc3f756-22cd-49c9-bd6e-643c69474512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Migration 20581c3d-4128-40cb-bc8e-671d21b0f169 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Starting finish_migration {{(pid=75257) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance directory exists: not creating {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 02:17:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Creating image(s)
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk. size=21474836480 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk 21474836480 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk 21474836480" returned: 0 in 0.230s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Ensure instance console log exists: /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Start _get_guest_xml network_info=[{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2074904170-network", "vif_mac": "fa:16:3e:40:6e:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9a93beac-7712-4954-8fc6-fca22f5c22b8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ce3a9680-3062-4e7d-8af3-81c31f3f499c', 'attached_at': '2023-11-14T02:17:04.000000', 'detached_at': '', 'volume_id': 'b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'serial': 'b4786ccd-1c45-41bb-ae1d-76c3e036a112'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:17:04 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:04 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:17:04 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:17:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:17:04 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:17:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:17:04 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1133d364-071f-4176-a86e-6d0c731c8932]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:17:04 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2957e1-30f2-45a7-b387-bd23beef59dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112] added
Nov 14 02:17:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab151d-c1bf-4caa-94e1-d233374f42de]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5c8189-2182-46b2-b466-e0ade1bdb881]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypbaiVoH {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypbaiVoH" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c6a0d-9e59-48b4-bf8a-a2af74e4f5f7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ypbaiVoH'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb9538f-eca4-4986-b646-7b929f9ba24e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ed0a20-fa64-4278-89d0-eed04170980b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:17:05 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:17:05 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d17b268-42a4-4020-a675-71ae36be638b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]
Nov 14 02:17:05 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.
Nov 14 02:17:05 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb8c9dd-17fe-4a60-95cb-65df7b3755cc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8798064-3dcc-4764-bd61-0ba5e7142f05]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:17:05 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:17:05 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:17:05 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:17:05 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af91634-c329-48ac-ab98-e3882b9bc59a]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:17:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26265383633336139', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265383633336139', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-164252655',display_name='tempest-ServerActionsTestOtherB-server-164252655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-164252655',id=21,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA==',key_name='tempest-keypair-1362037621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5dcd87f632574f81813bc7606a8fe70e',ramdisk_id='',reservation_id='r-5x0q0qiq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2069029360',owner_user_name='tempest-ServerActionsTestOtherB-2069029360-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73fe859f2604a1bbf70f01587cf015c',uuid=ce3a9680-3062-4e7d-8af3-81c31f3f499c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2074904170-network", "vif_mac": "fa:16:3e:40:6e:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converting VIF {"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2074904170-network", "vif_mac": "fa:16:3e:40:6e:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:17:06 user nova-compute[75257]:   <uuid>ce3a9680-3062-4e7d-8af3-81c31f3f499c</uuid>
Nov 14 02:17:06 user nova-compute[75257]:   <name>instance-00000015</name>
Nov 14 02:17:06 user nova-compute[75257]:   <memory>2097152</memory>
Nov 14 02:17:06 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:17:06 user nova-compute[75257]:   <metadata>
Nov 14 02:17:06 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:17:06 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:17:06 user nova-compute[75257]:       <nova:name>tempest-ServerActionsTestOtherB-server-164252655</nova:name>
Nov 14 02:17:06 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:17:04</nova:creationTime>
Nov 14 02:17:06 user nova-compute[75257]:       <nova:flavor name="m1.small">
Nov 14 02:17:06 user nova-compute[75257]:         <nova:memory>2048</nova:memory>
Nov 14 02:17:06 user nova-compute[75257]:         <nova:disk>20</nova:disk>
Nov 14 02:17:06 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:17:06 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:17:06 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:17:06 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:17:06 user nova-compute[75257]:       <nova:owner>
Nov 14 02:17:06 user nova-compute[75257]:         <nova:user uuid="b73fe859f2604a1bbf70f01587cf015c">tempest-ServerActionsTestOtherB-2069029360-project-member</nova:user>
Nov 14 02:17:06 user nova-compute[75257]:         <nova:project uuid="5dcd87f632574f81813bc7606a8fe70e">tempest-ServerActionsTestOtherB-2069029360</nova:project>
Nov 14 02:17:06 user nova-compute[75257]:       </nova:owner>
Nov 14 02:17:06 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:17:06 user nova-compute[75257]:       <nova:ports>
Nov 14 02:17:06 user nova-compute[75257]:         <nova:port uuid="ed73d0a9-0d24-470f-9fef-56c5474f0a9e">
Nov 14 02:17:06 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 02:17:06 user nova-compute[75257]:         </nova:port>
Nov 14 02:17:06 user nova-compute[75257]:       </nova:ports>
Nov 14 02:17:06 user nova-compute[75257]:     </nova:instance>
Nov 14 02:17:06 user nova-compute[75257]:   </metadata>
Nov 14 02:17:06 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:17:06 user nova-compute[75257]:     <system>
Nov 14 02:17:06 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:17:06 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:17:06 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:17:06 user nova-compute[75257]:       <entry name="serial">ce3a9680-3062-4e7d-8af3-81c31f3f499c</entry>
Nov 14 02:17:06 user nova-compute[75257]:       <entry name="uuid">ce3a9680-3062-4e7d-8af3-81c31f3f499c</entry>
Nov 14 02:17:06 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:17:06 user nova-compute[75257]:     </system>
Nov 14 02:17:06 user nova-compute[75257]:   </sysinfo>
Nov 14 02:17:06 user nova-compute[75257]:   <os>
Nov 14 02:17:06 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:17:06 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:17:06 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:17:06 user nova-compute[75257]:   </os>
Nov 14 02:17:06 user nova-compute[75257]:   <features>
Nov 14 02:17:06 user nova-compute[75257]:     <acpi/>
Nov 14 02:17:06 user nova-compute[75257]:     <apic/>
Nov 14 02:17:06 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:17:06 user nova-compute[75257]:   </features>
Nov 14 02:17:06 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:17:06 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:17:06 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:17:06 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:17:06 user nova-compute[75257]:   </clock>
Nov 14 02:17:06 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:17:06 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:17:06 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:17:06 user nova-compute[75257]:   </cpu>
Nov 14 02:17:06 user nova-compute[75257]:   <devices>
Nov 14 02:17:06 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:17:06 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:17:06 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk"/>
Nov 14 02:17:06 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:17:06 user nova-compute[75257]:     </disk>
Nov 14 02:17:06 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:17:06 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:17:06 user nova-compute[75257]:       <source dev="/dev/sdb"/>
Nov 14 02:17:06 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:17:06 user nova-compute[75257]:       <serial>b4786ccd-1c45-41bb-ae1d-76c3e036a112</serial>
Nov 14 02:17:06 user nova-compute[75257]:     </disk>
Nov 14 02:17:06 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:17:06 user nova-compute[75257]:       <mac address="fa:16:3e:40:6e:3c"/>
Nov 14 02:17:06 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:17:06 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:17:06 user nova-compute[75257]:       <target dev="taped73d0a9-0d"/>
Nov 14 02:17:06 user nova-compute[75257]:     </interface>
Nov 14 02:17:06 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:17:06 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/console.log" append="off"/>
Nov 14 02:17:06 user nova-compute[75257]:     </serial>
Nov 14 02:17:06 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:17:06 user nova-compute[75257]:     <video>
Nov 14 02:17:06 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:17:06 user nova-compute[75257]:     </video>
Nov 14 02:17:06 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:17:06 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:17:06 user nova-compute[75257]:     </rng>
Nov 14 02:17:06 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:17:06 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:17:06 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:17:06 user nova-compute[75257]:     </memballoon>
Nov 14 02:17:06 user nova-compute[75257]:   </devices>
Nov 14 02:17:06 user nova-compute[75257]: </domain>
Nov 14 02:17:06 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-164252655',display_name='tempest-ServerActionsTestOtherB-server-164252655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-164252655',id=21,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA==',key_name='tempest-keypair-1362037621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5dcd87f632574f81813bc7606a8fe70e',ramdisk_id='',reservation_id='r-5x0q0qiq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2069029360',owner_user_name='tempest-ServerActionsTestOtherB-2069029360-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73fe859f2604a1bbf70f01587cf015c',uuid=ce3a9680-3062-4e7d-8af3-81c31f3f499c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2074904170-network", "vif_mac": "fa:16:3e:40:6e:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converting VIF {"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2074904170-network", "vif_mac": "fa:16:3e:40:6e:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG os_vif [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7017007e-89e8-5e44-9605-e311f7edbe68', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped73d0a9-0d, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped73d0a9-0d, col_values=(('qos', UUID('5dd90c85-2add-4ab5-9b9a-074cfbeda1b6')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped73d0a9-0d, col_values=(('external_ids', {'iface-id': 'ed73d0a9-0d24-470f-9fef-56c5474f0a9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:6e:3c', 'vm-uuid': 'ce3a9680-3062-4e7d-8af3-81c31f3f499c'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:06 user nova-compute[75257]: INFO os_vif [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d')
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] No VIF found with MAC fa:16:3e:40:6e:3c, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:17:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:07 user nova-compute[75257]: WARNING nova.compute.manager [req-a3fdcc8d-6ddd-4347-8e0c-8f4fba7bca0f req-bf2ee0bd-f458-4688-b1f9-da7921f86e0f service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state active and task_state resize_finish.
Nov 14 02:17:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:17:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance running successfully.
Nov 14 02:17:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Failed to set time: agent not configured {{(pid=75257) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 02:17:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3351cb7d-5d96-4e19-8e68-ac1db720b62d tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] finish_migration finished successfully. {{(pid=75257) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 02:17:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:10 user nova-compute[75257]: WARNING nova.compute.manager [req-9dfad2fa-41b3-4e68-ab7d-dfa30d20b9b9 req-a49d4315-b20a-4df5-8865-9ef567b8dabf service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state active and task_state resize_finish.
Nov 14 02:17:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:11 user nova-compute[75257]: INFO nova.compute.manager [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Rescuing
Nov 14 02:17:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:17:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquired lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:17:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:17:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG nova.network.neutron [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updating instance_info_cache with network_info: [{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Releasing lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-unplugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-unplugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:12 user nova-compute[75257]: WARNING nova.compute.manager [req-416139a1-3e7c-4955-861f-057dafff6dd0 req-c60d87f1-d075-44ca-b020-0cd67b12aecc service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-unplugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state active and task_state rescuing.
Nov 14 02:17:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:13 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Instance destroyed successfully.
Nov 14 02:17:13 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Attempting rescue
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75257) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Instance directory exists: not creating {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 02:17:13 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Creating image(s)
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'trusted_certs' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue" returned: 0 in 0.048s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'migration_context' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.base [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Start _get_guest_xml network_info=[{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "vif_mac": "fa:16:3e:16:e4:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'resources' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.base [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'numa_topology' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.base [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:17:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'vcpu_model' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.base [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1099099117',display_name='tempest-ServerRescueNegativeTestJSON-server-1099099117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1099099117',id=19,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-ls19w9yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:12:36Z,user_data=None,user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "vif_mac": "fa:16:3e:16:e4:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "vif_mac": "fa:16:3e:16:e4:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:e4:fb,bridge_name='br-int',has_traffic_filtering=True,id=775872ee-1599-4358-9d11-07252d3855ce,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775872ee-15') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'pci_devices' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.objects.base [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:17:13 user nova-compute[75257]:   <uuid>91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef</uuid>
Nov 14 02:17:13 user nova-compute[75257]:   <name>instance-00000013</name>
Nov 14 02:17:13 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:17:13 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:17:13 user nova-compute[75257]:   <metadata>
Nov 14 02:17:13 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:17:13 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:17:13 user nova-compute[75257]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1099099117</nova:name>
Nov 14 02:17:13 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:17:13</nova:creationTime>
Nov 14 02:17:13 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:17:13 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:17:13 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:17:13 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:17:13 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:17:13 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:17:13 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:17:13 user nova-compute[75257]:       <nova:owner>
Nov 14 02:17:13 user nova-compute[75257]:         <nova:user uuid="a5f8a4942cb54c9aa5377e6d2df1aa7b">tempest-ServerRescueNegativeTestJSON-66746497-project-member</nova:user>
Nov 14 02:17:13 user nova-compute[75257]:         <nova:project uuid="68ac9795cbe748fc8079de4bb8234cd3">tempest-ServerRescueNegativeTestJSON-66746497</nova:project>
Nov 14 02:17:13 user nova-compute[75257]:       </nova:owner>
Nov 14 02:17:13 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:17:13 user nova-compute[75257]:       <nova:ports>
Nov 14 02:17:13 user nova-compute[75257]:         <nova:port uuid="775872ee-1599-4358-9d11-07252d3855ce">
Nov 14 02:17:13 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 02:17:13 user nova-compute[75257]:         </nova:port>
Nov 14 02:17:13 user nova-compute[75257]:       </nova:ports>
Nov 14 02:17:13 user nova-compute[75257]:     </nova:instance>
Nov 14 02:17:13 user nova-compute[75257]:   </metadata>
Nov 14 02:17:13 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:17:13 user nova-compute[75257]:     <system>
Nov 14 02:17:13 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:17:13 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:17:13 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:17:13 user nova-compute[75257]:       <entry name="serial">91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef</entry>
Nov 14 02:17:13 user nova-compute[75257]:       <entry name="uuid">91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef</entry>
Nov 14 02:17:13 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:17:13 user nova-compute[75257]:     </system>
Nov 14 02:17:13 user nova-compute[75257]:   </sysinfo>
Nov 14 02:17:13 user nova-compute[75257]:   <os>
Nov 14 02:17:13 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:17:13 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:17:13 user nova-compute[75257]:   </os>
Nov 14 02:17:13 user nova-compute[75257]:   <features>
Nov 14 02:17:13 user nova-compute[75257]:     <acpi/>
Nov 14 02:17:13 user nova-compute[75257]:     <apic/>
Nov 14 02:17:13 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:17:13 user nova-compute[75257]:   </features>
Nov 14 02:17:13 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:17:13 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:17:13 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:17:13 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:17:13 user nova-compute[75257]:   </clock>
Nov 14 02:17:13 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:17:13 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:17:13 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:17:13 user nova-compute[75257]:   </cpu>
Nov 14 02:17:13 user nova-compute[75257]:   <devices>
Nov 14 02:17:13 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:17:13 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:17:13 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue"/>
Nov 14 02:17:13 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:17:13 user nova-compute[75257]:     </disk>
Nov 14 02:17:13 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:17:13 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:17:13 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk"/>
Nov 14 02:17:13 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:17:13 user nova-compute[75257]:     </disk>
Nov 14 02:17:13 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:17:13 user nova-compute[75257]:       <mac address="fa:16:3e:16:e4:fb"/>
Nov 14 02:17:13 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:17:13 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:17:13 user nova-compute[75257]:       <target dev="tap775872ee-15"/>
Nov 14 02:17:13 user nova-compute[75257]:     </interface>
Nov 14 02:17:13 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:17:13 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/console.log" append="off"/>
Nov 14 02:17:13 user nova-compute[75257]:     </serial>
Nov 14 02:17:13 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:17:13 user nova-compute[75257]:     <video>
Nov 14 02:17:13 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:17:13 user nova-compute[75257]:     </video>
Nov 14 02:17:13 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:17:13 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:17:13 user nova-compute[75257]:     </rng>
Nov 14 02:17:13 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:17:13 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:17:13 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:17:13 user nova-compute[75257]:     </memballoon>
Nov 14 02:17:13 user nova-compute[75257]:   </devices>
Nov 14 02:17:13 user nova-compute[75257]: </domain>
Nov 14 02:17:13 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:17:13 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Instance destroyed successfully.
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:17:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No VIF found with MAC fa:16:3e:16:e4:fb, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:17:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:14 user nova-compute[75257]: WARNING nova.compute.manager [req-d3aa21b0-b7d4-480f-ae82-79f9f7b4a184 req-5670aa6e-28a5-410c-9f8a-55de8ad48700 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state active and task_state rescuing.
Nov 14 02:17:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:16 user nova-compute[75257]: WARNING nova.compute.manager [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state active and task_state rescuing.
Nov 14 02:17:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:16 user nova-compute[75257]: DEBUG nova.compute.manager [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:16 user nova-compute[75257]: WARNING nova.compute.manager [req-ad04ca7f-6007-49d6-9068-9ea118b7eca4 req-5d38243b-1150-4309-b8f3-84f0e9bc1aa1 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state active and task_state rescuing.
Nov 14 02:17:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-1b952d25-9ecf-4c58-9242-6a56c319e6d4 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:17:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:21 user nova-compute[75257]: DEBUG nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:17:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:17:21 user nova-compute[75257]: INFO nova.compute.claims [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Claim successful on node user
Nov 14 02:17:22 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG nova.network.neutron [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:17:22 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:17:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG nova.policy [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87f69eeadbaf45bfa01dfdfa5efcccb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfe231fae1941f4970c17e344df8b81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:17:22 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Creating image(s)
Nov 14 02:17:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "/opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "/opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "d60a08f4533bd589e292cba83e4ac3bd240df23d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "d60a08f4533bd589e292cba83e4ac3bd240df23d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG nova.network.neutron [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Successfully created port: fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG nova.virt.images [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 948f42ca-5bd2-49c0-b496-c1902fa97d96 was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d.part /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d.part /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d.converted" returned: 0 in 0.400s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "d60a08f4533bd589e292cba83e4ac3bd240df23d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.225s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "d60a08f4533bd589e292cba83e4ac3bd240df23d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "d60a08f4533bd589e292cba83e4ac3bd240df23d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Successfully updated port: fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquired lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing instance network info cache due to event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] Acquiring lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d,backing_fmt=raw /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d,backing_fmt=raw /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk 1073741824" returned: 0 in 0.055s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "d60a08f4533bd589e292cba83e4ac3bd240df23d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:17:24 user nova-compute[75257]: INFO nova.compute.claims [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Claim successful on node user
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updating instance_info_cache with network_info: [{"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Releasing lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Instance network_info: |[{"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] Acquired lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.neutron [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Cannot resize image /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Ensure instance console log exists: /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Start _get_guest_xml network_info=[{"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:17:19Z,direct_url=<?>,disk_format='qcow2',id=948f42ca-5bd2-49c0-b496-c1902fa97d96,min_disk=0,min_ram=0,name='tempest-scenario-img--352714765',owner='9cfe231fae1941f4970c17e344df8b81',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:17:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '948f42ca-5bd2-49c0-b496-c1902fa97d96'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:17:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:17:19Z,direct_url=<?>,disk_format='qcow2',id=948f42ca-5bd2-49c0-b496-c1902fa97d96,min_disk=0,min_ram=0,name='tempest-scenario-img--352714765',owner='9cfe231fae1941f4970c17e344df8b81',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:17:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-417851207',display_name='tempest-TestMinimumBasicScenario-server-417851207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-417851207',id=29,image_ref='948f42ca-5bd2-49c0-b496-c1902fa97d96',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Qai4/c8jmrXF+7sKrGwGzLpkwduY4d7UGfz12nhhhboF8T7Ehv+HP+Y/q9Ste7wY5aWF97tpO6Jn7SyB48wCDuYBRmb0sUQHOXHaWm+kkFbHfcXXqC4LxndEphuYhLw==',key_name='tempest-TestMinimumBasicScenario-1262712773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cfe231fae1941f4970c17e344df8b81',ramdisk_id='',reservation_id='r-gnye2bln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='948f42ca-5bd2-49c0-b496-c1902fa97d96',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1293674307',owner_user_name='tempest-TestMinimumBasicScenario-1293674307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:17:22Z,user_data=None,user_id='87f69eeadbaf45bfa01dfdfa5efcccb3',uuid=9e083a62-27d0-4633-a608-7eb34ddafe2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converting VIF {"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0d:51,bridge_name='br-int',has_traffic_filtering=True,id=fb569262-fb03-4fa0-9d3d-80ab79690476,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb569262-fb') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.objects.instance [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e083a62-27d0-4633-a608-7eb34ddafe2c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:17:24 user nova-compute[75257]:   <uuid>9e083a62-27d0-4633-a608-7eb34ddafe2c</uuid>
Nov 14 02:17:24 user nova-compute[75257]:   <name>instance-0000001d</name>
Nov 14 02:17:24 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:17:24 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:17:24 user nova-compute[75257]:   <metadata>
Nov 14 02:17:24 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:17:24 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:17:24 user nova-compute[75257]:       <nova:name>tempest-TestMinimumBasicScenario-server-417851207</nova:name>
Nov 14 02:17:24 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:17:24</nova:creationTime>
Nov 14 02:17:24 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:17:24 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:17:24 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:17:24 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:17:24 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:17:24 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:17:24 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:17:24 user nova-compute[75257]:       <nova:owner>
Nov 14 02:17:24 user nova-compute[75257]:         <nova:user uuid="87f69eeadbaf45bfa01dfdfa5efcccb3">tempest-TestMinimumBasicScenario-1293674307-project-member</nova:user>
Nov 14 02:17:24 user nova-compute[75257]:         <nova:project uuid="9cfe231fae1941f4970c17e344df8b81">tempest-TestMinimumBasicScenario-1293674307</nova:project>
Nov 14 02:17:24 user nova-compute[75257]:       </nova:owner>
Nov 14 02:17:24 user nova-compute[75257]:       <nova:root type="image" uuid="948f42ca-5bd2-49c0-b496-c1902fa97d96"/>
Nov 14 02:17:24 user nova-compute[75257]:       <nova:ports>
Nov 14 02:17:24 user nova-compute[75257]:         <nova:port uuid="fb569262-fb03-4fa0-9d3d-80ab79690476">
Nov 14 02:17:24 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 02:17:24 user nova-compute[75257]:         </nova:port>
Nov 14 02:17:24 user nova-compute[75257]:       </nova:ports>
Nov 14 02:17:24 user nova-compute[75257]:     </nova:instance>
Nov 14 02:17:24 user nova-compute[75257]:   </metadata>
Nov 14 02:17:24 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:17:24 user nova-compute[75257]:     <system>
Nov 14 02:17:24 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:17:24 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:17:24 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:17:24 user nova-compute[75257]:       <entry name="serial">9e083a62-27d0-4633-a608-7eb34ddafe2c</entry>
Nov 14 02:17:24 user nova-compute[75257]:       <entry name="uuid">9e083a62-27d0-4633-a608-7eb34ddafe2c</entry>
Nov 14 02:17:24 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:17:24 user nova-compute[75257]:     </system>
Nov 14 02:17:24 user nova-compute[75257]:   </sysinfo>
Nov 14 02:17:24 user nova-compute[75257]:   <os>
Nov 14 02:17:24 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:17:24 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:17:24 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:17:24 user nova-compute[75257]:   </os>
Nov 14 02:17:24 user nova-compute[75257]:   <features>
Nov 14 02:17:24 user nova-compute[75257]:     <acpi/>
Nov 14 02:17:24 user nova-compute[75257]:     <apic/>
Nov 14 02:17:24 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:17:24 user nova-compute[75257]:   </features>
Nov 14 02:17:24 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:17:24 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:17:24 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:17:24 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:17:24 user nova-compute[75257]:   </clock>
Nov 14 02:17:24 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:17:24 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:17:24 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:17:24 user nova-compute[75257]:   </cpu>
Nov 14 02:17:24 user nova-compute[75257]:   <devices>
Nov 14 02:17:24 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:17:24 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:17:24 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk"/>
Nov 14 02:17:24 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:17:24 user nova-compute[75257]:     </disk>
Nov 14 02:17:24 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:17:24 user nova-compute[75257]:       <mac address="fa:16:3e:4d:0d:51"/>
Nov 14 02:17:24 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:17:24 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:17:24 user nova-compute[75257]:       <target dev="tapfb569262-fb"/>
Nov 14 02:17:24 user nova-compute[75257]:     </interface>
Nov 14 02:17:24 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:17:24 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/console.log" append="off"/>
Nov 14 02:17:24 user nova-compute[75257]:     </serial>
Nov 14 02:17:24 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:17:24 user nova-compute[75257]:     <video>
Nov 14 02:17:24 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:17:24 user nova-compute[75257]:     </video>
Nov 14 02:17:24 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:17:24 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:17:24 user nova-compute[75257]:     </rng>
Nov 14 02:17:24 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:17:24 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:17:24 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:17:24 user nova-compute[75257]:     </memballoon>
Nov 14 02:17:24 user nova-compute[75257]:   </devices>
Nov 14 02:17:24 user nova-compute[75257]: </domain>
Nov 14 02:17:24 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-417851207',display_name='tempest-TestMinimumBasicScenario-server-417851207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-417851207',id=29,image_ref='948f42ca-5bd2-49c0-b496-c1902fa97d96',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Qai4/c8jmrXF+7sKrGwGzLpkwduY4d7UGfz12nhhhboF8T7Ehv+HP+Y/q9Ste7wY5aWF97tpO6Jn7SyB48wCDuYBRmb0sUQHOXHaWm+kkFbHfcXXqC4LxndEphuYhLw==',key_name='tempest-TestMinimumBasicScenario-1262712773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cfe231fae1941f4970c17e344df8b81',ramdisk_id='',reservation_id='r-gnye2bln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='948f42ca-5bd2-49c0-b496-c1902fa97d96',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1293674307',owner_user_name='tempest-TestMinimumBasicScenario-1293674307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:17:22Z,user_data=None,user_id='87f69eeadbaf45bfa01dfdfa5efcccb3',uuid=9e083a62-27d0-4633-a608-7eb34ddafe2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converting VIF {"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0d:51,bridge_name='br-int',has_traffic_filtering=True,id=fb569262-fb03-4fa0-9d3d-80ab79690476,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb569262-fb') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG os_vif [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0d:51,bridge_name='br-int',has_traffic_filtering=True,id=fb569262-fb03-4fa0-9d3d-80ab79690476,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb569262-fb') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94289464-45d3-55c3-b2cf-fc6f39b11c1d', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb569262-fb, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb569262-fb, col_values=(('qos', UUID('bf4c5409-a31c-4c09-aa9c-e5531bd61d73')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb569262-fb, col_values=(('external_ids', {'iface-id': 'fb569262-fb03-4fa0-9d3d-80ab79690476', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:0d:51', 'vm-uuid': '9e083a62-27d0-4633-a608-7eb34ddafe2c'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:24 user nova-compute[75257]: INFO os_vif [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:0d:51,bridge_name='br-int',has_traffic_filtering=True,id=fb569262-fb03-4fa0-9d3d-80ab79690476,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb569262-fb')
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No VIF found with MAC fa:16:3e:4d:0d:51, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.neutron [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updated VIF entry in instance network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.neutron [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updating instance_info_cache with network_info: [{"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2233db98-72b5-48e1-9ec5-cac902987e29 req-aa0b2f33-63f4-4cdb-a3bf-d3f1c0cb20a3 service nova] Releasing lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:17:24 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:17:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG nova.policy [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ffa5574e531479993ef301510f1d9e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ba9547629f4ea1b40424e277e17d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:17:25 user nova-compute[75257]: INFO nova.virt.block_device [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Booting with volume bfe732f2-6802-4277-9e26-6ee51b70df83 at /dev/vda
Nov 14 02:17:25 user nova-compute[75257]: DEBUG os_brick.utils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e01c1e-3809-4742-b3b6-c5536e12f381]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc62f74-43b1-4c3c-b56f-a371d9621cde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[00807501-c418-4985-8099-af949b9fefc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3432725-f512-4ac5-ba18-a9bd995024be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:17:25 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:17:25 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea9d4a3-1565-4185-9382-e9fab9b55dcb]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG os_brick.utils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating existing volume attachment record: f38543ea-de35-472e-9665-55a96bd4b12a {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Successfully created port: 36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:17:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:26 user nova-compute[75257]: WARNING nova.compute.manager [req-3a9ca4f7-4b96-476a-8d18-d76c682a6000 req-bd885cbf-edfb-4a39-9539-8182011d9b86 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state building and task_state spawning.
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Successfully updated port: 36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquired lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-changed-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Refreshing instance network info cache due to event network-changed-36f42e8b-2ba5-49e9-9966-67431aed797f. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] Acquiring lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating instance_info_cache with network_info: [{"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Releasing lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Instance network_info: |[{"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] Acquired lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG nova.network.neutron [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Refreshing network info cache for port 36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:17:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:27 user nova-compute[75257]: DEBUG nova.network.neutron [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updated VIF entry in instance network info cache for port 36f42e8b-2ba5-49e9-9966-67431aed797f. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:17:27 user nova-compute[75257]: DEBUG nova.network.neutron [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating instance_info_cache with network_info: [{"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-339a702a-0573-4f71-b8c5-733e0583e2c7 req-d96cf8a8-b9b1-4614-aba6-98d19ae40df6 service nova] Releasing lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:17:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Instance spawned successfully.
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:28 user nova-compute[75257]: INFO nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:28 user nova-compute[75257]: WARNING nova.compute.manager [req-3dab1590-6985-4ed8-9cff-0685a00ef7cc req-5778bfa1-27ad-47af-a8bd-feddb1749f78 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state building and task_state spawning.
Nov 14 02:17:28 user nova-compute[75257]: INFO nova.compute.manager [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Took 6.57 seconds to build instance.
Nov 14 02:17:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-147c8945-06ea-4c65-8ecd-88b08ff4e90f tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.677s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:17:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Creating image(s)
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Ensure instance console log exists: /opt/stack/data/nova/instances/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Start _get_guest_xml network_info=[{"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f38543ea-de35-472e-9665-55a96bd4b12a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcdzUPrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90d8b16a-a1f1-4625-a715-e5e8bd87d66b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfe732f2-6802-4277-9e26-6ee51b70df83', 'serial': 'bfe732f2-6802-4277-9e26-6ee51b70df83'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:17:29 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:29 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:17:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcdzUPrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:17:30 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:17:30 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:17:30 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78445ff-8eb4-4e0f-a629-6dc2ccb6e8a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:17:30 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d061c030-bc36-46c5-8f78-86e4770006dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83] added
Nov 14 02:17:30 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a72219-1742-4241-ab39-b4975a94308e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1374ead-5b21-4d8d-a05e-98720d31c15c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcdzUPrq {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcdzUPrq" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f045c7-8a8b-4338-9ceb-0d4b1be50ff0]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZcdzUPrq'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5e6266-f9a1-441e-a4b9-59d08c464a11]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cbc3e2-c32d-4406-8dc9-b3009754063b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:17:30 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:17:30 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:17:30 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:17:30 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aea3e4-5eb8-424a-ad1c-657925646286]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260]
Nov 14 02:17:30 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260] successful.
Nov 14 02:17:30 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd2fac7-0079-4800-bc5f-a0d84673705a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[337a7a2f-c690-4168-bc1b-222d8c61cd60]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:17:30 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:17:30 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:17:30 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:17:30 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:17:30 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:17:30 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a94acb5-6727-4d19-b453-85c1e95cb888]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:17:30 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcdzUPrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23264316164636566', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264316164636566', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1977700667',display_name='tempest-ServerActionsTestOtherA-server-1977700667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1977700667',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww==',key_name='tempest-keypair-1627475945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-jhpchxnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=90d8b16a-a1f1-4625-a715-e5e8bd87d66b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'pci_devices' on Instance uuid 90d8b16a-a1f1-4625-a715-e5e8bd87d66b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:17:31 user nova-compute[75257]:   <uuid>90d8b16a-a1f1-4625-a715-e5e8bd87d66b</uuid>
Nov 14 02:17:31 user nova-compute[75257]:   <name>instance-0000001e</name>
Nov 14 02:17:31 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:17:31 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:17:31 user nova-compute[75257]:   <metadata>
Nov 14 02:17:31 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:17:31 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:17:31 user nova-compute[75257]:       <nova:name>tempest-ServerActionsTestOtherA-server-1977700667</nova:name>
Nov 14 02:17:31 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:17:29</nova:creationTime>
Nov 14 02:17:31 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:17:31 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:17:31 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:17:31 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:17:31 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:17:31 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:17:31 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:17:31 user nova-compute[75257]:       <nova:owner>
Nov 14 02:17:31 user nova-compute[75257]:         <nova:user uuid="7ffa5574e531479993ef301510f1d9e3">tempest-ServerActionsTestOtherA-1988221692-project-member</nova:user>
Nov 14 02:17:31 user nova-compute[75257]:         <nova:project uuid="a1ba9547629f4ea1b40424e277e17d25">tempest-ServerActionsTestOtherA-1988221692</nova:project>
Nov 14 02:17:31 user nova-compute[75257]:       </nova:owner>
Nov 14 02:17:31 user nova-compute[75257]:       <nova:ports>
Nov 14 02:17:31 user nova-compute[75257]:         <nova:port uuid="36f42e8b-2ba5-49e9-9966-67431aed797f">
Nov 14 02:17:31 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 02:17:31 user nova-compute[75257]:         </nova:port>
Nov 14 02:17:31 user nova-compute[75257]:       </nova:ports>
Nov 14 02:17:31 user nova-compute[75257]:     </nova:instance>
Nov 14 02:17:31 user nova-compute[75257]:   </metadata>
Nov 14 02:17:31 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:17:31 user nova-compute[75257]:     <system>
Nov 14 02:17:31 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:17:31 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:17:31 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:17:31 user nova-compute[75257]:       <entry name="serial">90d8b16a-a1f1-4625-a715-e5e8bd87d66b</entry>
Nov 14 02:17:31 user nova-compute[75257]:       <entry name="uuid">90d8b16a-a1f1-4625-a715-e5e8bd87d66b</entry>
Nov 14 02:17:31 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:17:31 user nova-compute[75257]:     </system>
Nov 14 02:17:31 user nova-compute[75257]:   </sysinfo>
Nov 14 02:17:31 user nova-compute[75257]:   <os>
Nov 14 02:17:31 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:17:31 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:17:31 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:17:31 user nova-compute[75257]:   </os>
Nov 14 02:17:31 user nova-compute[75257]:   <features>
Nov 14 02:17:31 user nova-compute[75257]:     <acpi/>
Nov 14 02:17:31 user nova-compute[75257]:     <apic/>
Nov 14 02:17:31 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:17:31 user nova-compute[75257]:   </features>
Nov 14 02:17:31 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:17:31 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:17:31 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:17:31 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:17:31 user nova-compute[75257]:   </clock>
Nov 14 02:17:31 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:17:31 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:17:31 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:17:31 user nova-compute[75257]:   </cpu>
Nov 14 02:17:31 user nova-compute[75257]:   <devices>
Nov 14 02:17:31 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:17:31 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:17:31 user nova-compute[75257]:       <source dev="/dev/sdc"/>
Nov 14 02:17:31 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:17:31 user nova-compute[75257]:       <serial>bfe732f2-6802-4277-9e26-6ee51b70df83</serial>
Nov 14 02:17:31 user nova-compute[75257]:     </disk>
Nov 14 02:17:31 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:17:31 user nova-compute[75257]:       <mac address="fa:16:3e:a8:b7:c9"/>
Nov 14 02:17:31 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:17:31 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:17:31 user nova-compute[75257]:       <target dev="tap36f42e8b-2b"/>
Nov 14 02:17:31 user nova-compute[75257]:     </interface>
Nov 14 02:17:31 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:17:31 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/console.log" append="off"/>
Nov 14 02:17:31 user nova-compute[75257]:     </serial>
Nov 14 02:17:31 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:17:31 user nova-compute[75257]:     <video>
Nov 14 02:17:31 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:17:31 user nova-compute[75257]:     </video>
Nov 14 02:17:31 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:17:31 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:17:31 user nova-compute[75257]:     </rng>
Nov 14 02:17:31 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:17:31 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:17:31 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:17:31 user nova-compute[75257]:     </memballoon>
Nov 14 02:17:31 user nova-compute[75257]:   </devices>
Nov 14 02:17:31 user nova-compute[75257]: </domain>
Nov 14 02:17:31 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1977700667',display_name='tempest-ServerActionsTestOtherA-server-1977700667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1977700667',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww==',key_name='tempest-keypair-1627475945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-jhpchxnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=90d8b16a-a1f1-4625-a715-e5e8bd87d66b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG os_vif [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82debb31-7614-57f9-b4a6-402d397b8016', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36f42e8b-2b, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36f42e8b-2b, col_values=(('qos', UUID('b95a1a6c-e71d-4f77-b50f-a13209b64bbf')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36f42e8b-2b, col_values=(('external_ids', {'iface-id': '36f42e8b-2ba5-49e9-9966-67431aed797f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:b7:c9', 'vm-uuid': '90d8b16a-a1f1-4625-a715-e5e8bd87d66b'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:31 user nova-compute[75257]: INFO os_vif [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b')
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:17:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No VIF found with MAC fa:16:3e:a8:b7:c9, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] No waiting events found dispatching network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:32 user nova-compute[75257]: WARNING nova.compute.manager [req-e541976a-5fdf-4489-be76-8b7e4c892263 req-702559cc-e359-4c4f-8082-672a9220e05e service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received unexpected event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f for instance with vm_state building and task_state spawning.
Nov 14 02:17:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:17:34 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Instance spawned successfully.
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:17:34 user nova-compute[75257]: INFO nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 14 02:17:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:17:35 user nova-compute[75257]: INFO nova.compute.manager [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Took 10.94 seconds to build instance.
Nov 14 02:17:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] No waiting events found dispatching network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:35 user nova-compute[75257]: WARNING nova.compute.manager [req-585b4137-bd8c-4858-85cf-862e51c0ded9 req-aa89c73b-4af3-455c-bbdf-4c67a952d060 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received unexpected event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f for instance with vm_state active and task_state None.
Nov 14 02:17:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e5c088f5-0958-4ab3-b95a-89a8628c5aa3 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.052s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "4dc3f756-22cd-49c9-bd6e-643c69474512" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:43 user nova-compute[75257]: INFO nova.compute.manager [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Terminating instance
Nov 14 02:17:43 user nova-compute[75257]: DEBUG nova.compute.manager [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received event network-vif-unplugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] Acquiring lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] No waiting events found dispatching network-vif-unplugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-42476f4b-165a-4acc-8dfd-922f8210439c req-43f0ca2f-f2db-40d5-b86e-094aac223a39 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received event network-vif-unplugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:17:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Instance destroyed successfully.
Nov 14 02:17:44 user nova-compute[75257]: DEBUG nova.objects.instance [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lazy-loading 'resources' on Instance uuid 4dc3f756-22cd-49c9-bd6e-643c69474512 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-580478083',display_name='tempest-VolumesActionsTest-instance-580478083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-580478083',id=26,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:15:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cba8690ce4d3409194d26c988e0c4c51',ramdisk_id='',reservation_id='r-qazy63z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1429079730',owner_user_name='tempest-VolumesActionsTest-1429079730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:15:55Z,user_data=None,user_id='2bcdcb5c382f4e98bcfeb519efe7256b',uuid=4dc3f756-22cd-49c9-bd6e-643c69474512,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Converting VIF {"id": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "address": "fa:16:3e:0d:d1:fe", "network": {"id": "b1575ac8-6126-46b4-9240-a390b02b1e47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1767060337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cba8690ce4d3409194d26c988e0c4c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd03a0a-a8", "ovs_interfaceid": "3dd03a0a-a809-4e30-ac46-c9beb40caa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d1:fe,bridge_name='br-int',has_traffic_filtering=True,id=3dd03a0a-a809-4e30-ac46-c9beb40caa25,network=Network(b1575ac8-6126-46b4-9240-a390b02b1e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd03a0a-a8') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG os_vif [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d1:fe,bridge_name='br-int',has_traffic_filtering=True,id=3dd03a0a-a809-4e30-ac46-c9beb40caa25,network=Network(b1575ac8-6126-46b4-9240-a390b02b1e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd03a0a-a8') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dd03a0a-a8, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46aca4cf-2c42-441c-8720-8344307625d5) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:44 user nova-compute[75257]: INFO os_vif [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d1:fe,bridge_name='br-int',has_traffic_filtering=True,id=3dd03a0a-a809-4e30-ac46-c9beb40caa25,network=Network(b1575ac8-6126-46b4-9240-a390b02b1e47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd03a0a-a8')
Nov 14 02:17:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Deleting instance files /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512_del
Nov 14 02:17:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Deletion of /opt/stack/data/nova/instances/4dc3f756-22cd-49c9-bd6e-643c69474512_del complete
Nov 14 02:17:44 user nova-compute[75257]: INFO nova.compute.manager [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 02:17:44 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:17:44 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:45 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Took 0.49 seconds to deallocate network for instance.
Nov 14 02:17:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:45 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:17:45 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:17:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:45 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Deleted allocations for instance 4dc3f756-22cd-49c9-bd6e-643c69474512
Nov 14 02:17:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-a27bb865-4d93-4d8c-9ce0-f6bdf0fe22da tempest-VolumesActionsTest-1429079730 tempest-VolumesActionsTest-1429079730-project-member] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.944s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received event network-vif-plugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] Acquiring lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] Lock "4dc3f756-22cd-49c9-bd6e-643c69474512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] No waiting events found dispatching network-vif-plugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:45 user nova-compute[75257]: WARNING nova.compute.manager [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received unexpected event network-vif-plugged-3dd03a0a-a809-4e30-ac46-c9beb40caa25 for instance with vm_state deleted and task_state None.
Nov 14 02:17:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-fbd7099d-c867-409f-b73c-a70b39bdd406 req-8aa7e506-5821-43a7-a654-76109bbe47c3 service nova] [instance: 4dc3f756-22cd-49c9-bd6e-643c69474512] Received event network-vif-deleted-3dd03a0a-a809-4e30-ac46-c9beb40caa25 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "987991d7-8a45-49ee-a516-fac07e1d8589" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "987991d7-8a45-49ee-a516-fac07e1d8589" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:17:55 user nova-compute[75257]: INFO nova.compute.claims [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Claim successful on node user
Nov 14 02:17:55 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:17:55 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:17:55 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:17:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:17:56 user nova-compute[75257]: INFO nova.virt.block_device [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Booting with volume 46354624-906b-41f0-bf9d-b1a415b27359 at /dev/vda
Nov 14 02:17:56 user nova-compute[75257]: DEBUG nova.policy [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG os_brick.utils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0229077b-68fd-473c-8920-5bb03c2b29b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a983793c-94d0-4399-9f81-126fe8a4b6d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[110123dc-ee84-4c27-81f5-bcae1e89ea21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c55ac-7840-4bf6-b3f4-0b78b5078ea2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:17:56 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c64ab-1d6e-4b67-b1a1-7059c17f6aa6]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG os_brick.utils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Updating existing volume attachment record: b33c92cf-4fde-463d-b0ee-6fc3d9e604f2 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:56 user nova-compute[75257]: INFO nova.compute.manager [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Unrescuing
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquired lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:17:56 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Successfully created port: 3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updating instance_info_cache with network_info: [{"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Releasing lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'flavor' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-unplugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-unplugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:17:58 user nova-compute[75257]: WARNING nova.compute.manager [req-7ec2b5b5-7999-4ad9-b6e7-9ba544da4d9a req-a5b4c6da-0d6d-4ff6-ac26-d198d4118239 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-unplugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updating instance_info_cache with network_info: [{"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Successfully updated port: 3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "refresh_cache-987991d7-8a45-49ee-a516-fac07e1d8589" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquired lock "refresh_cache-987991d7-8a45-49ee-a516-fac07e1d8589" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Received event network-changed-3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Refreshing instance network info cache due to event network-changed-3f087bec-f4a3-4cc7-85a4-bbc27914cbae. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] Acquiring lock "refresh_cache-987991d7-8a45-49ee-a516-fac07e1d8589" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:17:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Instance destroyed successfully.
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Updating instance_info_cache with network_info: [{"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Releasing lock "refresh_cache-987991d7-8a45-49ee-a516-fac07e1d8589" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Instance network_info: |[{"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] Acquired lock "refresh_cache-987991d7-8a45-49ee-a516-fac07e1d8589" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:17:58 user nova-compute[75257]: DEBUG nova.network.neutron [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Refreshing network info cache for port 3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:17:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Updated VIF entry in instance network info cache for port 3f087bec-f4a3-4cc7-85a4-bbc27914cbae. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:17:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Updating instance_info_cache with network_info: [{"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:17:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-60c46b20-7a62-4ffb-beea-9e662dfccfc9 req-d1243e89-f352-41a2-92d3-95e3e7111d72 service nova] Releasing lock "refresh_cache-987991d7-8a45-49ee-a516-fac07e1d8589" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:17:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:00 user nova-compute[75257]: WARNING nova.compute.manager [req-37d2f4fb-50d5-4dd9-9003-c9e06f1716ed req-959ea292-ae7d-4f54-ac5e-0c24958f337c service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:18:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:18:01 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Creating image(s)
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Ensure instance console log exists: /opt/stack/data/nova/instances/987991d7-8a45-49ee-a516-fac07e1d8589/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Start _get_guest_xml network_info=[{"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b33c92cf-4fde-463d-b0ee-6fc3d9e604f2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKoAHZxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '987991d7-8a45-49ee-a516-fac07e1d8589', 'attached_at': '', 'detached_at': '', 'volume_id': '46354624-906b-41f0-bf9d-b1a415b27359', 'serial': '46354624-906b-41f0-bf9d-b1a415b27359'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:18:01 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:18:01 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKoAHZxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:01 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:01 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:01 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3c8732-c4b1-40f9-a7a9-5f712aa5c438]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:18:01 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5204f3-b122-4ba9-afc9-d412494b0780]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359] added
Nov 14 02:18:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a6a2d9-0f6b-4d2e-8286-b72e7063b783]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bb72fa-beee-4b6e-8cca-5b9e8c67ea1c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKoAHZxT {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKoAHZxT" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a33cb-9288-4fab-b1de-73dd2f2ef02c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKoAHZxT'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad388a5-08bd-4c2f-abb0-51da7ecb321b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[532c4fed-7b4f-4d8a-9e2d-023af294ef1b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.objects.instance [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'flavor' on Instance uuid 1bff6ecf-69c8-4940-8085-bb5f331ca91c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72c756e-99ae-4a94-8ea3-73b3f6bea9e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359, portal: 172.16.0.220,3260]
Nov 14 02:18:01 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359, portal: 172.16.0.220,3260] successful.
Nov 14 02:18:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f2afcc-1d8e-4dea-af1b-80c25aec5f27]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[23028f6d-c69a-4ed5-b4e1-732c9496432a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b86268-0fe1-4eef-8bba-9d5d05bcf106]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKoAHZxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:01 user nova-compute[75257]: INFO nova.compute.manager [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Attaching volume 082080ba-2293-4cc1-aad0-dacf038a663e to /dev/vdb
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.utils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ed6d26-42cb-4930-bf96-fd3e55095ce6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa74615-6825-475d-abf2-5dd5166193c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[439b547c-8b6c-469c-89dd-9485d359b91a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a8f9b5-dde8-498f-81e1-3f99fd138110]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:18:01 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e185492-854f-418f-b490-b3f5ec1feede]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG os_brick.utils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Updating existing volume attachment record: 479b346e-2120-4be2-8667-89213370382d {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:02 user nova-compute[75257]: WARNING nova.compute.manager [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received event network-changed-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Refreshing instance network info cache due to event network-changed-826a1529-1134-4ec2-bf5e-bc15f0af1f75. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Acquiring lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Acquired lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Refreshing network info cache for port 826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfad822f-0ab6-4470-88f8-19ffc6ada4c2 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '26533373132663462', 'path': '/dev/sde'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533373132663462', 'path': '/dev/sde'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1353021008',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1353021008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1353021008',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/+9CMLVpa/whcV4Tg4EhYx30XdEKCDGSZ2vFlN/0qq0gnew7RwjUilCukmZaf3/GXHbwxxxJNSxoEdKvsjjv2zhfLMlAbt82+zEF9wGzEhk9GhqMsdkL8/VTPKHfp1WQ==',key_name='tempest-keypair-1627011863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-608haspc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61052c8663184644aa445e8b29a9d6ed',uuid=987991d7-8a45-49ee-a516-fac07e1d8589,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:5c:45,bridge_name='br-int',has_traffic_filtering=True,id=3f087bec-f4a3-4cc7-85a4-bbc27914cbae,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f087bec-f4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'pci_devices' on Instance uuid 987991d7-8a45-49ee-a516-fac07e1d8589 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:18:02 user nova-compute[75257]:   <uuid>987991d7-8a45-49ee-a516-fac07e1d8589</uuid>
Nov 14 02:18:02 user nova-compute[75257]:   <name>instance-0000001f</name>
Nov 14 02:18:02 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:18:02 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:18:02 user nova-compute[75257]:   <metadata>
Nov 14 02:18:02 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:18:02 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:18:02 user nova-compute[75257]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1353021008</nova:name>
Nov 14 02:18:02 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:18:01</nova:creationTime>
Nov 14 02:18:02 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:18:02 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:18:02 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:18:02 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:18:02 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:18:02 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:18:02 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:18:02 user nova-compute[75257]:       <nova:owner>
Nov 14 02:18:02 user nova-compute[75257]:         <nova:user uuid="61052c8663184644aa445e8b29a9d6ed">tempest-TestVolumeBootPattern-1633655156-project-member</nova:user>
Nov 14 02:18:02 user nova-compute[75257]:         <nova:project uuid="6e49d1cf0a1c457ab943ffd360f1c3da">tempest-TestVolumeBootPattern-1633655156</nova:project>
Nov 14 02:18:02 user nova-compute[75257]:       </nova:owner>
Nov 14 02:18:02 user nova-compute[75257]:       <nova:ports>
Nov 14 02:18:02 user nova-compute[75257]:         <nova:port uuid="3f087bec-f4a3-4cc7-85a4-bbc27914cbae">
Nov 14 02:18:02 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 02:18:02 user nova-compute[75257]:         </nova:port>
Nov 14 02:18:02 user nova-compute[75257]:       </nova:ports>
Nov 14 02:18:02 user nova-compute[75257]:     </nova:instance>
Nov 14 02:18:02 user nova-compute[75257]:   </metadata>
Nov 14 02:18:02 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:18:02 user nova-compute[75257]:     <system>
Nov 14 02:18:02 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:18:02 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:18:02 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:18:02 user nova-compute[75257]:       <entry name="serial">987991d7-8a45-49ee-a516-fac07e1d8589</entry>
Nov 14 02:18:02 user nova-compute[75257]:       <entry name="uuid">987991d7-8a45-49ee-a516-fac07e1d8589</entry>
Nov 14 02:18:02 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:18:02 user nova-compute[75257]:     </system>
Nov 14 02:18:02 user nova-compute[75257]:   </sysinfo>
Nov 14 02:18:02 user nova-compute[75257]:   <os>
Nov 14 02:18:02 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:18:02 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:18:02 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:18:02 user nova-compute[75257]:   </os>
Nov 14 02:18:02 user nova-compute[75257]:   <features>
Nov 14 02:18:02 user nova-compute[75257]:     <acpi/>
Nov 14 02:18:02 user nova-compute[75257]:     <apic/>
Nov 14 02:18:02 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:18:02 user nova-compute[75257]:   </features>
Nov 14 02:18:02 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:18:02 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:18:02 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:18:02 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:18:02 user nova-compute[75257]:   </clock>
Nov 14 02:18:02 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:18:02 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:18:02 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:18:02 user nova-compute[75257]:   </cpu>
Nov 14 02:18:02 user nova-compute[75257]:   <devices>
Nov 14 02:18:02 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:18:02 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:18:02 user nova-compute[75257]:       <source dev="/dev/sde"/>
Nov 14 02:18:02 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:18:02 user nova-compute[75257]:       <serial>46354624-906b-41f0-bf9d-b1a415b27359</serial>
Nov 14 02:18:02 user nova-compute[75257]:     </disk>
Nov 14 02:18:02 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:18:02 user nova-compute[75257]:       <mac address="fa:16:3e:11:5c:45"/>
Nov 14 02:18:02 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:18:02 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:18:02 user nova-compute[75257]:       <target dev="tap3f087bec-f4"/>
Nov 14 02:18:02 user nova-compute[75257]:     </interface>
Nov 14 02:18:02 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:18:02 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/987991d7-8a45-49ee-a516-fac07e1d8589/console.log" append="off"/>
Nov 14 02:18:02 user nova-compute[75257]:     </serial>
Nov 14 02:18:02 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:18:02 user nova-compute[75257]:     <video>
Nov 14 02:18:02 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:18:02 user nova-compute[75257]:     </video>
Nov 14 02:18:02 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:18:02 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:18:02 user nova-compute[75257]:     </rng>
Nov 14 02:18:02 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:18:02 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:18:02 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:18:02 user nova-compute[75257]:     </memballoon>
Nov 14 02:18:02 user nova-compute[75257]:   </devices>
Nov 14 02:18:02 user nova-compute[75257]: </domain>
Nov 14 02:18:02 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1353021008',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1353021008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1353021008',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/+9CMLVpa/whcV4Tg4EhYx30XdEKCDGSZ2vFlN/0qq0gnew7RwjUilCukmZaf3/GXHbwxxxJNSxoEdKvsjjv2zhfLMlAbt82+zEF9wGzEhk9GhqMsdkL8/VTPKHfp1WQ==',key_name='tempest-keypair-1627011863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-608haspc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61052c8663184644aa445e8b29a9d6ed',uuid=987991d7-8a45-49ee-a516-fac07e1d8589,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:5c:45,bridge_name='br-int',has_traffic_filtering=True,id=3f087bec-f4a3-4cc7-85a4-bbc27914cbae,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f087bec-f4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG os_vif [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:5c:45,bridge_name='br-int',has_traffic_filtering=True,id=3f087bec-f4a3-4cc7-85a4-bbc27914cbae,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f087bec-f4') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ed3d38f-373c-5d11-aa46-b98065797096', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f087bec-f4, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f087bec-f4, col_values=(('qos', UUID('c7b89757-cda7-4df4-99a4-d1ea1ad3aff2')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f087bec-f4, col_values=(('external_ids', {'iface-id': '3f087bec-f4a3-4cc7-85a4-bbc27914cbae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:5c:45', 'vm-uuid': '987991d7-8a45-49ee-a516-fac07e1d8589'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Updated VIF entry in instance network info cache for port 826a1529-1134-4ec2-bf5e-bc15f0af1f75. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Updating instance_info_cache with network_info: [{"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:02 user nova-compute[75257]: INFO os_vif [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:5c:45,bridge_name='br-int',has_traffic_filtering=True,id=3f087bec-f4a3-4cc7-85a4-bbc27914cbae,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f087bec-f4')
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Releasing lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:02 user nova-compute[75257]: WARNING nova.compute.manager [req-97fb9f06-a069-43c0-b620-9119263d667f req-1190ff0b-e78e-4358-9097-b5be2885ca4b service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:18:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No VIF found with MAC fa:16:3e:11:5c:45, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Received event network-vif-plugged-3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] Acquiring lock "987991d7-8a45-49ee-a516-fac07e1d8589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] Lock "987991d7-8a45-49ee-a516-fac07e1d8589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] Lock "987991d7-8a45-49ee-a516-fac07e1d8589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] No waiting events found dispatching network-vif-plugged-3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:04 user nova-compute[75257]: WARNING nova.compute.manager [req-6f0a015b-7c06-4e29-bf25-cdad7b8bf8ae req-9e2bfbc0-5a71-4904-b14f-9b0611414896 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Received unexpected event network-vif-plugged-3f087bec-f4a3-4cc7-85a4-bbc27914cbae for instance with vm_state building and task_state spawning.
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:18:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Received event network-vif-plugged-3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] Acquiring lock "987991d7-8a45-49ee-a516-fac07e1d8589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] Lock "987991d7-8a45-49ee-a516-fac07e1d8589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] Lock "987991d7-8a45-49ee-a516-fac07e1d8589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] No waiting events found dispatching network-vif-plugged-3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:06 user nova-compute[75257]: WARNING nova.compute.manager [req-28ad7e3a-b055-44a6-a002-e266f6bf7810 req-5a107cac-2d4f-4bff-800a-be3d7287df86 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Received unexpected event network-vif-plugged-3f087bec-f4a3-4cc7-85a4-bbc27914cbae for instance with vm_state building and task_state spawning.
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pwXFVeEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:06 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:06 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:06 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Instance spawned successfully.
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:18:06 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:18:06 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7169MB free_disk=24.9708251953125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1b7c19-15b3-421b-801b-a84b5dc90202]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:18:06 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8041c20e-ae49-4869-a3b6-3c8c94597fc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e] added
Nov 14 02:18:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c4bdb-9415-435c-b0f8-b9b6d09c5662]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b2abd3-6ba0-4b01-b086-3fa176989622]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pwXFVeEM {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:06 user nova-compute[75257]: INFO nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pwXFVeEM" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6592a-995f-4e02-b828-c7e557534834]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pwXFVeEM'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Applying migration context for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c as it has an incoming, in-progress migration 20581c3d-4128-40cb-bc8e-671d21b0f169. Migration status is finished {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 02:18:06 user nova-compute[75257]: INFO nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating resource usage from migration 20581c3d-4128-40cb-bc8e-671d21b0f169
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c559d79a-b551-4c86-9edd-f9b4facd6cea]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance c226a1bf-4b89-49e0-ad8f-149849f12639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Migration 20581c3d-4128-40cb-bc8e-671d21b0f169 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 9e083a62-27d0-4633-a608-7eb34ddafe2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 987991d7-8a45-49ee-a516-fac07e1d8589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77d46fb-53ee-4e5a-8f0f-cd076af02beb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:06 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:06 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:06 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:06 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:06 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:06 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:06 user nova-compute[75257]: INFO nova.compute.manager [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Took 11.55 seconds to build instance.
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2743b105-0ff8-4c4f-a13a-5b1e1c99d2de tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "987991d7-8a45-49ee-a516-fac07e1d8589" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.649s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc3ee00-ce36-45e3-850e-eb6448ae5fb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e, portal: 172.16.0.220,3260]
Nov 14 02:18:06 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e, portal: 172.16.0.220,3260] successful.
Nov 14 02:18:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a06ffc-30cb-446e-97cb-fe33aceeb32f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf5ccc-8cd3-4d0f-84e0-bcf7d1575274]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:07 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:07 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:07 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:07 user nova-compute[75257]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e (non-flash)
Nov 14 02:18:07 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:07 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:07 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:07 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:07 user nova-compute[75257]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e (non-flash)
Nov 14 02:18:07 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1445023e-b2cf-49f9-ba3f-412111b50d99]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pwXFVeEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26665326236393133', 'path': '/dev/sdf'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665326236393133', 'path': '/dev/sdf'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:18:08 user nova-compute[75257]: DEBUG nova.objects.instance [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'flavor' on Instance uuid 1bff6ecf-69c8-4940-8085-bb5f331ca91c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:18:08 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:18:08 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:18:08 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:18:08 user nova-compute[75257]:   <serial>082080ba-2293-4cc1-aad0-dacf038a663e</serial>
Nov 14 02:18:08 user nova-compute[75257]: </disk>
Nov 14 02:18:08 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:18:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:18:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:18:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] No VIF found with MAC fa:16:3e:ff:25:62, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:18:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-990c00f3-53a6-4573-bcd8-c71192f7464b tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.017s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:10 user nova-compute[75257]: INFO nova.compute.manager [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Detaching volume 082080ba-2293-4cc1-aad0-dacf038a663e
Nov 14 02:18:10 user nova-compute[75257]: INFO nova.virt.block_device [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Attempting to driver detach volume 082080ba-2293-4cc1-aad0-dacf038a663e from mountpoint /dev/vdb
Nov 14 02:18:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Attempting to detach device vdb from instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:18:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:18:10 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:18:10 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:18:10 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:18:10 user nova-compute[75257]:   <serial>082080ba-2293-4cc1-aad0-dacf038a663e</serial>
Nov 14 02:18:10 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:18:10 user nova-compute[75257]: </disk>
Nov 14 02:18:10 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:18:10 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Successfully detached device vdb from instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c from the persistent domain config.
Nov 14 02:18:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:18:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:18:10 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:18:10 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:18:10 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:18:10 user nova-compute[75257]:   <serial>082080ba-2293-4cc1-aad0-dacf038a663e</serial>
Nov 14 02:18:10 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:18:10 user nova-compute[75257]: </disk>
Nov 14 02:18:10 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:18:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:18:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:21 user nova-compute[75257]: DEBUG nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:18:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:21 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:18:21 user nova-compute[75257]: INFO nova.compute.claims [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Claim successful on node user
Nov 14 02:18:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG nova.network.neutron [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:18:22 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:18:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG nova.policy [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0729cfec73f44f4eafb49d51f9ce01e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd36fad5dd04e79a672f69b7e100ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:18:22 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Creating image(s)
Nov 14 02:18:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "/opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "/opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.215s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.197s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk 1073741824" returned: 0 in 0.050s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG nova.network.neutron [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Successfully created port: 0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Cannot resize image /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Ensure instance console log exists: /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Successfully updated port: 0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "refresh_cache-0ef2a690-6f55-4d15-aac7-323e90b3e232" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquired lock "refresh_cache-0ef2a690-6f55-4d15-aac7-323e90b3e232" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received event network-changed-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Refreshing instance network info cache due to event network-changed-0fd725b9-7697-4d77-9a86-2fc0b2a80e03. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] Acquiring lock "refresh_cache-0ef2a690-6f55-4d15-aac7-323e90b3e232" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.neutron [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Updating instance_info_cache with network_info: [{"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Releasing lock "refresh_cache-0ef2a690-6f55-4d15-aac7-323e90b3e232" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Instance network_info: |[{"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] Acquired lock "refresh_cache-0ef2a690-6f55-4d15-aac7-323e90b3e232" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.neutron [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Refreshing network info cache for port 0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Start _get_guest_xml network_info=[{"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:18:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:18:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:18:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-438855487',display_name='tempest-VolumesSnapshotTestJSON-instance-438855487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-438855487',id=32,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNTz2d3GJuvS5CW6sTnUaAmT+KYp2EJmlGkb0wNZl+WWgtkFVUgYoM6HJEmYEFDMRwaBXEI+jsS3sdRXNVmHwb4u+menTy6hdNQs4uiJ1UBAoQVLynDNCjoRx4vv/+Ilg==',key_name='tempest-keypair-1744969399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdd36fad5dd04e79a672f69b7e100ae5',ramdisk_id='',reservation_id='r-k4rynj0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-408710193',owner_user_name='tempest-VolumesSnapshotTestJSON-408710193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:18:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0729cfec73f44f4eafb49d51f9ce01e2',uuid=0ef2a690-6f55-4d15-aac7-323e90b3e232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converting VIF {"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:91:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd725b9-7697-4d77-9a86-2fc0b2a80e03,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd725b9-76') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.objects.instance [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ef2a690-6f55-4d15-aac7-323e90b3e232 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:18:24 user nova-compute[75257]:   <uuid>0ef2a690-6f55-4d15-aac7-323e90b3e232</uuid>
Nov 14 02:18:24 user nova-compute[75257]:   <name>instance-00000020</name>
Nov 14 02:18:24 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:18:24 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:18:24 user nova-compute[75257]:   <metadata>
Nov 14 02:18:24 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:18:24 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:18:24 user nova-compute[75257]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-438855487</nova:name>
Nov 14 02:18:24 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:18:24</nova:creationTime>
Nov 14 02:18:24 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:18:24 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:18:24 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:18:24 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:18:24 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:18:24 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:18:24 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:18:24 user nova-compute[75257]:       <nova:owner>
Nov 14 02:18:24 user nova-compute[75257]:         <nova:user uuid="0729cfec73f44f4eafb49d51f9ce01e2">tempest-VolumesSnapshotTestJSON-408710193-project-member</nova:user>
Nov 14 02:18:24 user nova-compute[75257]:         <nova:project uuid="fdd36fad5dd04e79a672f69b7e100ae5">tempest-VolumesSnapshotTestJSON-408710193</nova:project>
Nov 14 02:18:24 user nova-compute[75257]:       </nova:owner>
Nov 14 02:18:24 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:18:24 user nova-compute[75257]:       <nova:ports>
Nov 14 02:18:24 user nova-compute[75257]:         <nova:port uuid="0fd725b9-7697-4d77-9a86-2fc0b2a80e03">
Nov 14 02:18:24 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 02:18:24 user nova-compute[75257]:         </nova:port>
Nov 14 02:18:24 user nova-compute[75257]:       </nova:ports>
Nov 14 02:18:24 user nova-compute[75257]:     </nova:instance>
Nov 14 02:18:24 user nova-compute[75257]:   </metadata>
Nov 14 02:18:24 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:18:24 user nova-compute[75257]:     <system>
Nov 14 02:18:24 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:18:24 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:18:24 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:18:24 user nova-compute[75257]:       <entry name="serial">0ef2a690-6f55-4d15-aac7-323e90b3e232</entry>
Nov 14 02:18:24 user nova-compute[75257]:       <entry name="uuid">0ef2a690-6f55-4d15-aac7-323e90b3e232</entry>
Nov 14 02:18:24 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:18:24 user nova-compute[75257]:     </system>
Nov 14 02:18:24 user nova-compute[75257]:   </sysinfo>
Nov 14 02:18:24 user nova-compute[75257]:   <os>
Nov 14 02:18:24 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:18:24 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:18:24 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:18:24 user nova-compute[75257]:   </os>
Nov 14 02:18:24 user nova-compute[75257]:   <features>
Nov 14 02:18:24 user nova-compute[75257]:     <acpi/>
Nov 14 02:18:24 user nova-compute[75257]:     <apic/>
Nov 14 02:18:24 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:18:24 user nova-compute[75257]:   </features>
Nov 14 02:18:24 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:18:24 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:18:24 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:18:24 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:18:24 user nova-compute[75257]:   </clock>
Nov 14 02:18:24 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:18:24 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:18:24 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:18:24 user nova-compute[75257]:   </cpu>
Nov 14 02:18:24 user nova-compute[75257]:   <devices>
Nov 14 02:18:24 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:18:24 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:18:24 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk"/>
Nov 14 02:18:24 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:18:24 user nova-compute[75257]:     </disk>
Nov 14 02:18:24 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:18:24 user nova-compute[75257]:       <mac address="fa:16:3e:38:91:13"/>
Nov 14 02:18:24 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:18:24 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:18:24 user nova-compute[75257]:       <target dev="tap0fd725b9-76"/>
Nov 14 02:18:24 user nova-compute[75257]:     </interface>
Nov 14 02:18:24 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:18:24 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/console.log" append="off"/>
Nov 14 02:18:24 user nova-compute[75257]:     </serial>
Nov 14 02:18:24 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:18:24 user nova-compute[75257]:     <video>
Nov 14 02:18:24 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:18:24 user nova-compute[75257]:     </video>
Nov 14 02:18:24 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:18:24 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:18:24 user nova-compute[75257]:     </rng>
Nov 14 02:18:24 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:18:24 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:18:24 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:18:24 user nova-compute[75257]:     </memballoon>
Nov 14 02:18:24 user nova-compute[75257]:   </devices>
Nov 14 02:18:24 user nova-compute[75257]: </domain>
Nov 14 02:18:24 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:18:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-438855487',display_name='tempest-VolumesSnapshotTestJSON-instance-438855487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-438855487',id=32,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNTz2d3GJuvS5CW6sTnUaAmT+KYp2EJmlGkb0wNZl+WWgtkFVUgYoM6HJEmYEFDMRwaBXEI+jsS3sdRXNVmHwb4u+menTy6hdNQs4uiJ1UBAoQVLynDNCjoRx4vv/+Ilg==',key_name='tempest-keypair-1744969399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdd36fad5dd04e79a672f69b7e100ae5',ramdisk_id='',reservation_id='r-k4rynj0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-408710193',owner_user_name='tempest-VolumesSnapshotTestJSON-408710193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:18:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0729cfec73f44f4eafb49d51f9ce01e2',uuid=0ef2a690-6f55-4d15-aac7-323e90b3e232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converting VIF {"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:91:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd725b9-7697-4d77-9a86-2fc0b2a80e03,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd725b9-76') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG os_vif [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:91:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd725b9-7697-4d77-9a86-2fc0b2a80e03,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd725b9-76') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '820b3cc4-ee70-5815-abbf-0600d88eb732', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fd725b9-76, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fd725b9-76, col_values=(('qos', UUID('2e68f5a2-03fe-4e40-a984-663ddbecd8ac')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fd725b9-76, col_values=(('external_ids', {'iface-id': '0fd725b9-7697-4d77-9a86-2fc0b2a80e03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:91:13', 'vm-uuid': '0ef2a690-6f55-4d15-aac7-323e90b3e232'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:24 user nova-compute[75257]: INFO os_vif [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:91:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd725b9-7697-4d77-9a86-2fc0b2a80e03,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd725b9-76')
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No VIF found with MAC fa:16:3e:38:91:13, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.neutron [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Updated VIF entry in instance network info cache for port 0fd725b9-7697-4d77-9a86-2fc0b2a80e03. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:18:24 user nova-compute[75257]: DEBUG nova.network.neutron [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Updating instance_info_cache with network_info: [{"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:18:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-780928ff-e92c-41bb-8ed9-1b64993a69be req-dc6ef93d-c198-4f2c-96d5-d3feb96fd744 service nova] Releasing lock "refresh_cache-0ef2a690-6f55-4d15-aac7-323e90b3e232" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received event network-vif-plugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] No waiting events found dispatching network-vif-plugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:26 user nova-compute[75257]: WARNING nova.compute.manager [req-d338b50d-5aa7-4fd6-a514-ee13e09e9d3a req-103d5dd0-8538-43f3-94a7-03822540479f service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received unexpected event network-vif-plugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance with vm_state building and task_state spawning.
Nov 14 02:18:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:18:28 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Instance spawned successfully.
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received event network-vif-plugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] No waiting events found dispatching network-vif-plugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:28 user nova-compute[75257]: WARNING nova.compute.manager [req-9a05e85c-c09d-41de-b7b0-3774af0f48d8 req-d4490e2f-a95a-4f20-b290-341b69af4fc9 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received unexpected event network-vif-plugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance with vm_state building and task_state spawning.
Nov 14 02:18:28 user nova-compute[75257]: INFO nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 14 02:18:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:18:28 user nova-compute[75257]: INFO nova.compute.manager [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Took 6.62 seconds to build instance.
Nov 14 02:18:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-210b199c-59e6-40cc-a3a3-daa50e5e5362 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.740s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-changed-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Refreshing instance network info cache due to event network-changed-8ae70a55-08c9-43dd-9982-4f97e0b19ea2. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:18:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] Acquiring lock "refresh_cache-8487e985-c0d1-4bbd-9c28-c3312d737285" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:18:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] Acquired lock "refresh_cache-8487e985-c0d1-4bbd-9c28-c3312d737285" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:18:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Refreshing network info cache for port 8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:18:30 user nova-compute[75257]: DEBUG nova.network.neutron [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Updated VIF entry in instance network info cache for port 8ae70a55-08c9-43dd-9982-4f97e0b19ea2. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:18:30 user nova-compute[75257]: DEBUG nova.network.neutron [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Updating instance_info_cache with network_info: [{"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:18:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a51ad4e2-7c51-49c2-a20f-34b3ee652993 req-cc8d2cad-9fe9-41d7-b1a7-6db2f4f03622 service nova] Releasing lock "refresh_cache-8487e985-c0d1-4bbd-9c28-c3312d737285" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:18:31 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c is timed out.
Nov 14 02:18:31 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Successfully detached device vdb from instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c from the live domain config.
Nov 14 02:18:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pwXFVeEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:31 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7973dee-659e-433c-abb6-9738e9ca357e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:18:31 user nova-compute[75257]: No targets found.
Nov 14 02:18:31 user nova-compute[75257]: iSNS:
Nov 14 02:18:31 user nova-compute[75257]: No targets found.
Nov 14 02:18:31 user nova-compute[75257]: STATIC:
Nov 14 02:18:31 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:18:31 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:31 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:31 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112
Nov 14 02:18:31 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:31 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:31 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:18:31 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:31 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:31 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:18:31 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:31 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:31 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e
Nov 14 02:18:31 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:31 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:31 user nova-compute[75257]: FIRMWARE:
Nov 14 02:18:31 user nova-compute[75257]: No targets found.
Nov 14 02:18:31 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:18:31 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:18:31 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f2928-db2c-4568-8835-662e4dcfc099]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f13d6d-dbf0-410d-abd2-45d929dc2ba4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:31 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:31 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:31 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:31 user nova-compute[75257]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e (non-flash)
Nov 14 02:18:31 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:31 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:31 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:31 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:31 user nova-compute[75257]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e (non-flash)
Nov 14 02:18:31 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a46328c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e'): ({'sdf'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Removing single pathed devices sdf {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab903a38-98f5-46d2-9c8f-55b14c8fe2ed]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d427fc58-c422-4ded-a585-61b3e30754bd]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Flushing IO for device /dev/sdf {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced7028a-b438-4b66-907f-b903467aebde]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG nova.objects.instance [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca8eac-092d-4a03-9039-ada0a18d63d8]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d8b390-8fae-4108-ad44-4ccd305b5836]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3c12e6-2f8a-46fc-a276-2e4f9042bebe]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e, portal: 172.16.0.220,3260]
Nov 14 02:18:31 user nova-compute[75257]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e, portal: 172.16.0.220,3260] successful.
Nov 14 02:18:31 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:082080ba-2293-4cc1-aad0-dacf038a663e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5338230b-0998-4d8d-8e12-6bad3b646e9a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] <== disconnect_volume: return (342ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:31 user nova-compute[75257]: INFO nova.compute.manager [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Attaching volume 994660a4-71d0-4feb-a152-bef2c9825c2f to /dev/vdb
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.utils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fe4c17-428e-4774-8df3-bb5aea6ca3f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e797f585-077a-47b1-8add-e90fcfa03d8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4238ca-9fb5-455f-b15f-cf153306ebdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b30aa7-5882-499c-8abf-4f890be79e1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:18:31 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:18:31 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aa5ad7-2608-47d1-b9f6-420b7555beaf]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG os_brick.utils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:31 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Updating existing volume attachment record: 64875616-e280-47cd-8bb7-bddafaf148a5 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:18:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:32 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'flavor' on Instance uuid 1bff6ecf-69c8-4940-8085-bb5f331ca91c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2facb859-fee7-4411-b1c8-185adc9ca7f3 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.740s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpHTsNQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:36 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4b3c19-6864-4cea-b73e-0cdf1cfbe9dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:18:36 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca461e9-85e6-4bb8-95f3-724c1bf838ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f] added
Nov 14 02:18:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6fb3dd-41fd-443c-aa6f-2e282d7cb58c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4299e079-daa9-4e9a-8000-1c82bf9b430f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpHTsNQM {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpHTsNQM" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4427ec9e-abf3-4e95-a17b-c0fd5e6cc347]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PpHTsNQM'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[302195c4-1597-4388-86f7-bf6278f6ded1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[062bbe4c-0d15-44b7-9e35-f18b1c4e88c2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f876a29-5d16-44fa-bb8f-7b6470ae49cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f, portal: 172.16.0.220,3260]
Nov 14 02:18:36 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f, portal: 172.16.0.220,3260] successful.
Nov 14 02:18:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fbf1c8-99c5-4093-b4c1-a9de91c8d2b2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af55f1-a145-4818-a582-1266021c1969]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:36 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4dd70e-1990-4329-aa44-8c7a12fb113e]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:18:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpHTsNQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:18:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23265373036643837', 'path': '/dev/sdf'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265373036643837', 'path': '/dev/sdf'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:18:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:18:37 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:18:37 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:18:37 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:18:37 user nova-compute[75257]:   <serial>994660a4-71d0-4feb-a152-bef2c9825c2f</serial>
Nov 14 02:18:37 user nova-compute[75257]: </disk>
Nov 14 02:18:37 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:18:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:18:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:18:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No VIF found with MAC fa:16:3e:ce:02:34, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:18:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-47da8ca3-1b11-4102-80f5-fc146771ae31 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.735s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:40 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:41 user nova-compute[75257]: INFO nova.compute.manager [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Attaching volume 97417f33-08c2-4f70-ba3e-d5a6ff297411 to /dev/vdc
Nov 14 02:18:41 user nova-compute[75257]: DEBUG os_brick.utils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec69b8b-5bcd-4ebb-a5eb-b964e5fa5bfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3f677e-71b2-4458-a47e-3f7988292e92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5e5783-29ba-4b8e-8d14-ad624deca883]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b3fa70-1823-4124-81e7-609f8eec3e13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:18:41 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:18:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2886e1c9-9828-4f5f-a337-733efd991069]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG os_brick.utils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:41 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Updating existing volume attachment record: 12c11f81-eaa9-4dd1-af7d-4a34d6da59f2 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG nova.network.neutron [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Port ed73d0a9-0d24-470f-9fef-56c5474f0a9e binding to destination host user is already ACTIVE {{(pid=75257) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquired lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG nova.network.neutron [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG nova.network.neutron [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating instance_info_cache with network_info: [{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Releasing lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Creating tmpfile /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/tmp6k9fis_q to verify with other compute node that the instance is on the same shared storage. {{(pid=75257) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-unplugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-unplugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:44 user nova-compute[75257]: WARNING nova.compute.manager [req-7bd78b22-025f-4321-9df4-d6ec39166cb5 req-e589ebd9-9d18-42d9-ada9-e707a729d60c service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-unplugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state resized and task_state resize_reverting.
Nov 14 02:18:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:45 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance destroyed successfully.
Nov 14 02:18:45 user nova-compute[75257]: DEBUG nova.objects.instance [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lazy-loading 'resources' on Instance uuid ce3a9680-3062-4e7d-8af3-81c31f3f499c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-164252655',display_name='tempest-ServerActionsTestOtherB-server-164252655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-164252655',id=21,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA==',key_name='tempest-keypair-1362037621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dcd87f632574f81813bc7606a8fe70e',ramdisk_id='',reservation_id='r-5x0q0qiq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2069029360',owner_user_name='tempest-ServerActionsTestOtherB-2069029360-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73fe859f2604a1bbf70f01587cf015c',uuid=ce3a9680-3062-4e7d-8af3-81c31f3f499c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converting VIF {"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_vif [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped73d0a9-0d, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5dd90c85-2add-4ab5-9b9a-074cfbeda1b6) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:45 user nova-compute[75257]: INFO os_vif [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d')
Nov 14 02:18:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:45 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c089034-2d9b-4739-bd0c-1c772600204c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:18:45 user nova-compute[75257]: No targets found.
Nov 14 02:18:45 user nova-compute[75257]: iSNS:
Nov 14 02:18:45 user nova-compute[75257]: No targets found.
Nov 14 02:18:45 user nova-compute[75257]: STATIC:
Nov 14 02:18:45 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:18:45 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:45 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:45 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112
Nov 14 02:18:45 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:45 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:45 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:18:45 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:45 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:45 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f
Nov 14 02:18:45 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:45 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:45 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:18:45 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:18:45 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:18:45 user nova-compute[75257]: FIRMWARE:
Nov 14 02:18:45 user nova-compute[75257]: No targets found.
Nov 14 02:18:45 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:18:45 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:18:45 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5211d8a9-8c38-4fba-ad24-436df92a6c98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e0dffa-043a-4f7c-870c-7aebc9020b7e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:45 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:45 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a414c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc7dd0-ba78-4776-89f9-f488df6e1775]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54d2f33-c6ea-49d1-8490-c636c55f716c]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2af30d-590d-442b-94d2-b459940f939e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b50edf-0fa0-446c-8501-824fe5d3388e]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b92e8fa-b630-4aae-ba9a-b35c66599db4]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[36193562-b003-48e2-8bf2-954856dffb23]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]
Nov 14 02:18:45 user nova-compute[75257]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.
Nov 14 02:18:45 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae32aa09-a1e6-412c-bfb9-fd1bd158bdcb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] <== disconnect_volume: return (349ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzVcmDbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:45 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:45 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:45 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[246e3995-e62b-46e8-b5e4-1f4613aa8c79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:18:45 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f6e3b1-dedc-466c-aa48-02293af0f05f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411] added
Nov 14 02:18:45 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeda085-1ca2-4652-b5b8-f0f189bb2a6a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed3643-68e8-4422-a8b6-b7fc076ad2e4]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fzVcmDbR {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fzVcmDbR" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb83004-9ba6-4503-9e3f-741f688c1f80]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fzVcmDbR'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1e3cba-ce66-4d9d-924f-06a201330063]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dbd1d3-98ef-45d7-9749-28a720b15832]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:45 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:45 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:45 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[80165839-9863-47c0-b6f7-60900343844e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411, portal: 172.16.0.220,3260]
Nov 14 02:18:46 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411, portal: 172.16.0.220,3260] successful.
Nov 14 02:18:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c9a46c-5148-4fc2-8f6d-fc783cb22270]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8f60d9-4492-4ca3-912f-2c502b6ae335]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:46 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:46 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:46 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:46 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:18:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:46 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:46 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:46 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:46 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:18:46 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e510fd7d-0de6-445a-8259-51b06bfe02f9]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzVcmDbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG nova.objects.instance [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lazy-loading 'migration_context' on Instance uuid ce3a9680-3062-4e7d-8af3-81c31f3f499c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG nova.objects.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Object Instance<ce3a9680-3062-4e7d-8af3-81c31f3f499c> lazy-loaded attributes: resources,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:46 user nova-compute[75257]: WARNING nova.compute.manager [req-4aa14956-1665-4eb7-9d28-9c7037d6cdfe req-77953b80-15e6-4df7-b01c-61e53e920998 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state resized and task_state resize_reverting.
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23839343864656338', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839343864656338', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.516s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:18:47 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:18:47 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:18:47 user nova-compute[75257]:   <target dev="vdc" bus="virtio"/>
Nov 14 02:18:47 user nova-compute[75257]:   <serial>97417f33-08c2-4f70-ba3e-d5a6ff297411</serial>
Nov 14 02:18:47 user nova-compute[75257]: </disk>
Nov 14 02:18:47 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:18:47 user nova-compute[75257]: INFO nova.compute.manager [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Swapping old allocation on dict_keys(['d089fce4-28ce-4f05-848e-0c103c9d96c6']) held by migration 20581c3d-4128-40cb-bc8e-671d21b0f169 for instance
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Overwriting current allocation {'allocations': {'d089fce4-28ce-4f05-848e-0c103c9d96c6': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 36}}, 'project_id': '5dcd87f632574f81813bc7606a8fe70e', 'user_id': 'b73fe859f2604a1bbf70f01587cf015c', 'consumer_generation': 1} on consumer ce3a9680-3062-4e7d-8af3-81c31f3f499c {{(pid=75257) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquired lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] No VIF found with MAC fa:16:3e:ce:02:34, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:18:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2b2bb097-2777-42ef-879e-2d10395c7a26 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.616s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG nova.network.neutron [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating instance_info_cache with network_info: [{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Releasing lock "refresh_cache-ce3a9680-3062-4e7d-8af3-81c31f3f499c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG os_brick.utils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c28c80-8e25-458e-b190-be8ed7b6c6bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b01e25-6e79-4697-a877-ab398a9c8733]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[20405ffd-0601-4881-a01c-0c37a7ccf79f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c402e416-8133-41ed-8517-fc2b3d35c00e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:18:48 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:18:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d8f480-5b39-4aef-b552-69940e6205dc]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:18:48 user nova-compute[75257]: DEBUG os_brick.utils [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:49 user nova-compute[75257]: INFO nova.compute.manager [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Detaching volume 994660a4-71d0-4feb-a152-bef2c9825c2f
Nov 14 02:18:49 user nova-compute[75257]: INFO nova.virt.block_device [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Attempting to driver detach volume 994660a4-71d0-4feb-a152-bef2c9825c2f from mountpoint /dev/vdb
Nov 14 02:18:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Attempting to detach device vdb from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:18:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:18:49 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:18:49 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:18:49 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:18:49 user nova-compute[75257]:   <serial>994660a4-71d0-4feb-a152-bef2c9825c2f</serial>
Nov 14 02:18:49 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:18:49 user nova-compute[75257]: </disk>
Nov 14 02:18:49 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:18:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully detached device vdb from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 from the persistent domain config.
Nov 14 02:18:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:18:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:18:49 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:18:49 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:18:49 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:18:49 user nova-compute[75257]:   <serial>994660a4-71d0-4feb-a152-bef2c9825c2f</serial>
Nov 14 02:18:49 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:18:49 user nova-compute[75257]: </disk>
Nov 14 02:18:49 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:18:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:18:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Starting finish_revert_migration {{(pid=75257) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Start _get_guest_xml network_info=[{"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'aa66b3dd-d627-4dbb-b98b-3f0095b48ada', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ce3a9680-3062-4e7d-8af3-81c31f3f499c', 'attached_at': '2023-11-14T02:18:52.000000', 'detached_at': '', 'volume_id': 'b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'serial': 'b4786ccd-1c45-41bb-ae1d-76c3e036a112'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:18:52 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:18:52 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.objects.instance [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lazy-loading 'vcpu_model' on Instance uuid ce3a9680-3062-4e7d-8af3-81c31f3f499c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:18:52 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:52 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:18:52 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8223c148-7c0d-4b8d-bd10-cd9835e5ad9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:18:52 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b473fa88-da2a-4e30-b166-0bd8381c1292]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112] added
Nov 14 02:18:52 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae15f49-1321-4b2a-9010-0187ebcbcc7d]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce8b1ff-99fd-41c4-ad57-7ddf36868774]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypbaiVoH {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypbaiVoH" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[337cf8eb-7167-4956-b75c-6270a8f68b31]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ypbaiVoH'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e7d11-8c8f-4528-b686-31d2992005ff]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe713a7d-7fc4-40ff-9a23-4a9cf040dabb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62cfa8f-ce3a-4a41-9c2e-66126b1ba450]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]
Nov 14 02:18:52 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.
Nov 14 02:18:52 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0d8c3b-1182-4b43-a167-ac38bfe0416c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8f076e-fe69-4e70-be99-12c6ad566ee2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:18:52 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0570d2a9-ed3b-41e9-b3c3-f3c59fd21f02]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:18:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26265383633336139', 'path': '/dev/sdg'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265383633336139', 'path': '/dev/sdg'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-164252655',display_name='tempest-ServerActionsTestOtherB-server-164252655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-164252655',id=21,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA==',key_name='tempest-keypair-1362037621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5dcd87f632574f81813bc7606a8fe70e',ramdisk_id='',reservation_id='r-5x0q0qiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2069029360',owner_user_name='tempest-ServerActionsTestOtherB-2069029360-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73fe859f2604a1bbf70f01587cf015c',uuid=ce3a9680-3062-4e7d-8af3-81c31f3f499c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converting VIF {"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:18:53 user nova-compute[75257]:   <uuid>ce3a9680-3062-4e7d-8af3-81c31f3f499c</uuid>
Nov 14 02:18:53 user nova-compute[75257]:   <name>instance-00000015</name>
Nov 14 02:18:53 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:18:53 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:18:53 user nova-compute[75257]:   <metadata>
Nov 14 02:18:53 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:18:53 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:18:53 user nova-compute[75257]:       <nova:name>tempest-ServerActionsTestOtherB-server-164252655</nova:name>
Nov 14 02:18:53 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:18:52</nova:creationTime>
Nov 14 02:18:53 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:18:53 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:18:53 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:18:53 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:18:53 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:18:53 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:18:53 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:18:53 user nova-compute[75257]:       <nova:owner>
Nov 14 02:18:53 user nova-compute[75257]:         <nova:user uuid="b73fe859f2604a1bbf70f01587cf015c">tempest-ServerActionsTestOtherB-2069029360-project-member</nova:user>
Nov 14 02:18:53 user nova-compute[75257]:         <nova:project uuid="5dcd87f632574f81813bc7606a8fe70e">tempest-ServerActionsTestOtherB-2069029360</nova:project>
Nov 14 02:18:53 user nova-compute[75257]:       </nova:owner>
Nov 14 02:18:53 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:18:53 user nova-compute[75257]:       <nova:ports>
Nov 14 02:18:53 user nova-compute[75257]:         <nova:port uuid="ed73d0a9-0d24-470f-9fef-56c5474f0a9e">
Nov 14 02:18:53 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 02:18:53 user nova-compute[75257]:         </nova:port>
Nov 14 02:18:53 user nova-compute[75257]:       </nova:ports>
Nov 14 02:18:53 user nova-compute[75257]:     </nova:instance>
Nov 14 02:18:53 user nova-compute[75257]:   </metadata>
Nov 14 02:18:53 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:18:53 user nova-compute[75257]:     <system>
Nov 14 02:18:53 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:18:53 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:18:53 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:18:53 user nova-compute[75257]:       <entry name="serial">ce3a9680-3062-4e7d-8af3-81c31f3f499c</entry>
Nov 14 02:18:53 user nova-compute[75257]:       <entry name="uuid">ce3a9680-3062-4e7d-8af3-81c31f3f499c</entry>
Nov 14 02:18:53 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:18:53 user nova-compute[75257]:     </system>
Nov 14 02:18:53 user nova-compute[75257]:   </sysinfo>
Nov 14 02:18:53 user nova-compute[75257]:   <os>
Nov 14 02:18:53 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:18:53 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:18:53 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:18:53 user nova-compute[75257]:   </os>
Nov 14 02:18:53 user nova-compute[75257]:   <features>
Nov 14 02:18:53 user nova-compute[75257]:     <acpi/>
Nov 14 02:18:53 user nova-compute[75257]:     <apic/>
Nov 14 02:18:53 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:18:53 user nova-compute[75257]:   </features>
Nov 14 02:18:53 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:18:53 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:18:53 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:18:53 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:18:53 user nova-compute[75257]:   </clock>
Nov 14 02:18:53 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:18:53 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:18:53 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:18:53 user nova-compute[75257]:   </cpu>
Nov 14 02:18:53 user nova-compute[75257]:   <devices>
Nov 14 02:18:53 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:18:53 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:18:53 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk"/>
Nov 14 02:18:53 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:18:53 user nova-compute[75257]:     </disk>
Nov 14 02:18:53 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:18:53 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:18:53 user nova-compute[75257]:       <source dev="/dev/sdg"/>
Nov 14 02:18:53 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:18:53 user nova-compute[75257]:       <serial>b4786ccd-1c45-41bb-ae1d-76c3e036a112</serial>
Nov 14 02:18:53 user nova-compute[75257]:     </disk>
Nov 14 02:18:53 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:18:53 user nova-compute[75257]:       <mac address="fa:16:3e:40:6e:3c"/>
Nov 14 02:18:53 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:18:53 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:18:53 user nova-compute[75257]:       <target dev="taped73d0a9-0d"/>
Nov 14 02:18:53 user nova-compute[75257]:     </interface>
Nov 14 02:18:53 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:18:53 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/console.log" append="off"/>
Nov 14 02:18:53 user nova-compute[75257]:     </serial>
Nov 14 02:18:53 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:18:53 user nova-compute[75257]:     <video>
Nov 14 02:18:53 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:18:53 user nova-compute[75257]:     </video>
Nov 14 02:18:53 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:18:53 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:18:53 user nova-compute[75257]:     </rng>
Nov 14 02:18:53 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:18:53 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:18:53 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:18:53 user nova-compute[75257]:     </memballoon>
Nov 14 02:18:53 user nova-compute[75257]:   </devices>
Nov 14 02:18:53 user nova-compute[75257]: </domain>
Nov 14 02:18:53 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-164252655',display_name='tempest-ServerActionsTestOtherB-server-164252655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-164252655',id=21,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA==',key_name='tempest-keypair-1362037621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5dcd87f632574f81813bc7606a8fe70e',ramdisk_id='',reservation_id='r-5x0q0qiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2069029360',owner_user_name='tempest-ServerActionsTestOtherB-2069029360-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73fe859f2604a1bbf70f01587cf015c',uuid=ce3a9680-3062-4e7d-8af3-81c31f3f499c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converting VIF {"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG os_vif [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7017007e-89e8-5e44-9605-e311f7edbe68', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped73d0a9-0d, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped73d0a9-0d, col_values=(('qos', UUID('b54aa4b5-6392-4f71-9b06-701e6d9af738')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped73d0a9-0d, col_values=(('external_ids', {'iface-id': 'ed73d0a9-0d24-470f-9fef-56c5474f0a9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:6e:3c', 'vm-uuid': 'ce3a9680-3062-4e7d-8af3-81c31f3f499c'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:18:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:53 user nova-compute[75257]: INFO os_vif [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d')
Nov 14 02:18:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:55 user nova-compute[75257]: WARNING nova.compute.manager [req-8b11d5d4-f0ef-4189-8559-92409f11c41b req-d5a38cdc-dca9-4781-aedd-a777c0a6e16c service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state resized and task_state resize_reverting.
Nov 14 02:18:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:56 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:18:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance running successfully.
Nov 14 02:18:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] finish_revert_migration finished successfully. {{(pid=75257) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 02:18:57 user nova-compute[75257]: INFO nova.compute.manager [None req-82c67235-920e-479a-9e5e-96defe7e82f3 tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating instance to original state: 'active'
Nov 14 02:18:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:18:57 user nova-compute[75257]: WARNING nova.compute.manager [req-ceffca67-b4ad-4481-ac7f-e030db571ec4 req-c7409647-5737-4912-94f1-5339eab48a2d service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state resized and task_state resize_reverting.
Nov 14 02:18:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:18:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:18:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:18:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:18:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:18:58 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:18:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:18:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received event network-changed-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Refreshing instance network info cache due to event network-changed-826a1529-1134-4ec2-bf5e-bc15f0af1f75. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] Acquiring lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] Acquired lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG nova.network.neutron [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Refreshing network info cache for port 826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:01 user nova-compute[75257]: INFO nova.compute.manager [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Terminating instance
Nov 14 02:19:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received event network-vif-unplugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] No waiting events found dispatching network-vif-unplugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-02e7bc53-64e1-45bf-9924-e3da84c840f5 req-a6ab5b7a-1ff9-4947-8f7f-f00d5e47c376 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received event network-vif-unplugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Updated VIF entry in instance network info cache for port 826a1529-1134-4ec2-bf5e-bc15f0af1f75. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Updating instance_info_cache with network_info: [{"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-80d083f3-84f3-4da7-876e-1b665cceb2b0 req-f36f1fac-178c-41f8-901a-b68f1dee54a6 service nova] Releasing lock "refresh_cache-1bff6ecf-69c8-4940-8085-bb5f331ca91c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:02 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Instance destroyed successfully.
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'resources' on Instance uuid 1bff6ecf-69c8-4940-8085-bb5f331ca91c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-707905753',display_name='tempest-TestStampPattern-server-707905753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-707905753',id=27,image_ref='083a0fe3-040d-45de-871d-f50781bb7cab',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA29cl1fr1mQddCmz0NjRlHZtGI31Z/HpB+Nsx3OGKzEmi6USs0zIOlWO+VML9vORCyVCO+2Wn/r9l3Z21RvN0BLUGIBRfBmYCbzP7P30tWvVkVZygqVIesWMX0qe0GeCw==',key_name='tempest-TestStampPattern-863039138',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:16:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbfae642569847a2a3ac4cd4066aeb22',ramdisk_id='',reservation_id='r-2oz142ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c226a1bf-4b89-49e0-ad8f-149849f12639',image_min_disk='1',image_min_ram='0',image_owner_id='fbfae642569847a2a3ac4cd4066aeb22',image_owner_project_name='tempest-TestStampPattern-1994748770',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1994748770-project-member',image_user_id='089b000c028b46b998f2c128a6cf3d0a',owner_project_name='tempest-TestStampPattern-1994748770',owner_user_name='tempest-TestStampPattern-1994748770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:16:16Z,user_data=None,user_id='089b000c028b46b998f2c128a6cf3d0a',uuid=1bff6ecf-69c8-4940-8085-bb5f331ca91c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converting VIF {"id": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "address": "fa:16:3e:ff:25:62", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap826a1529-11", "ovs_interfaceid": "826a1529-1134-4ec2-bf5e-bc15f0af1f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:25:62,bridge_name='br-int',has_traffic_filtering=True,id=826a1529-1134-4ec2-bf5e-bc15f0af1f75,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap826a1529-11') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG os_vif [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:25:62,bridge_name='br-int',has_traffic_filtering=True,id=826a1529-1134-4ec2-bf5e-bc15f0af1f75,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap826a1529-11') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap826a1529-11, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f55ec63-e015-40ee-a795-91dea3c4ee2f) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:02 user nova-compute[75257]: INFO os_vif [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:25:62,bridge_name='br-int',has_traffic_filtering=True,id=826a1529-1134-4ec2-bf5e-bc15f0af1f75,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap826a1529-11')
Nov 14 02:19:02 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Deleting instance files /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c_del
Nov 14 02:19:02 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Deletion of /opt/stack/data/nova/instances/1bff6ecf-69c8-4940-8085-bb5f331ca91c_del complete
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:02 user nova-compute[75257]: INFO nova.compute.manager [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Unrescuing
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquired lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:19:03 user nova-compute[75257]: INFO nova.compute.manager [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updating instance_info_cache with network_info: [{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Releasing lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.objects.instance [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'flavor' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received event network-vif-deleted-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:03 user nova-compute[75257]: INFO nova.compute.manager [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Neutron deleted interface 826a1529-1134-4ec2-bf5e-bc15f0af1f75; detaching it from the instance and deleting it from the info cache
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:03 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Took 0.52 seconds to deallocate network for instance.
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-a1a16bbd-5ce7-4d07-ad87-906dfe042bc7 req-fcbd2dd0-96e9-4409-8bb2-272a12477305 service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Detach interface failed, port_id=826a1529-1134-4ec2-bf5e-bc15f0af1f75, reason: Instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:19:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received event network-vif-plugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Acquiring lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] No waiting events found dispatching network-vif-plugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:04 user nova-compute[75257]: WARNING nova.compute.manager [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] [instance: 1bff6ecf-69c8-4940-8085-bb5f331ca91c] Received unexpected event network-vif-plugged-826a1529-1134-4ec2-bf5e-bc15f0af1f75 for instance with vm_state deleted and task_state None.
Nov 14 02:19:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-unplugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-unplugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:04 user nova-compute[75257]: WARNING nova.compute.manager [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-unplugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:19:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:04 user nova-compute[75257]: WARNING nova.compute.manager [req-6c43bc8b-d58d-4ddf-971e-2ffa3fb19d7f req-727c6e70-20f9-4a5f-8346-49e79d5d306a service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:19:04 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:19:04 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:19:04 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7028MB free_disk=24.95718765258789GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Instance destroyed successfully.
Nov 14 02:19:04 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.274s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.418s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:04 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Deleted allocations for instance 1bff6ecf-69c8-4940-8085-bb5f331ca91c
Nov 14 02:19:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ea320bd3-7ef1-488d-ad49-0c1472b8b1f4 tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "1bff6ecf-69c8-4940-8085-bb5f331ca91c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance c226a1bf-4b89-49e0-ad8f-149849f12639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 9e083a62-27d0-4633-a608-7eb34ddafe2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 987991d7-8a45-49ee-a516-fac07e1d8589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:06 user nova-compute[75257]: WARNING nova.compute.manager [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:19:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:06 user nova-compute[75257]: WARNING nova.compute.manager [req-55ebe368-46d2-4fb8-b848-a0ef66fa3fd1 req-66121f88-0de7-41c7-bd4a-1d71e7f07bc7 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:19:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-3618f74d-012c-494b-8800-e81341871c9b tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:19:09 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 is timed out.
Nov 14 02:19:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully detached device vdb from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 from the live domain config.
Nov 14 02:19:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpHTsNQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:19:09 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b7a6a-97da-496b-8f8b-bc245207c1af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:19:09 user nova-compute[75257]: No targets found.
Nov 14 02:19:09 user nova-compute[75257]: iSNS:
Nov 14 02:19:09 user nova-compute[75257]: No targets found.
Nov 14 02:19:09 user nova-compute[75257]: STATIC:
Nov 14 02:19:09 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:19:09 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:09 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:09 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112
Nov 14 02:19:09 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:09 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:09 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:19:09 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:09 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:09 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f
Nov 14 02:19:09 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:09 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:09 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:19:09 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:09 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:09 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411
Nov 14 02:19:09 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:09 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:09 user nova-compute[75257]: FIRMWARE:
Nov 14 02:19:09 user nova-compute[75257]: No targets found.
Nov 14 02:19:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:19:09 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:19:09 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[425c074d-4dc2-40a1-ae65-86bc59156e21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c05723a-3ab4-46d0-a95c-a722ee606137]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:09 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c119a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f'): ({'sdf'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Removing single pathed devices sdf {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faf59f5-35cc-4ba2-9f6f-1e1c397a8718]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbde937-c58e-4bd9-bb0a-eb7f7d8921e9]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flushing IO for device /dev/sdf {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae181755-660b-4398-9337-6a2e06476709]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[89983d7c-5d59-4381-8b52-43e8a6258d40]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de0b430-a0f6-4224-9e2c-1f02e9598b38]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef61db6-89e3-4e27-b4e4-2370d484d92b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f, portal: 172.16.0.220,3260]
Nov 14 02:19:10 user nova-compute[75257]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f, portal: 172.16.0.220,3260] successful.
Nov 14 02:19:10 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994660a4-71d0-4feb-a152-bef2c9825c2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d25dc30-67b5-48fa-8a09-3414d91c4990]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== disconnect_volume: return (372ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG nova.objects.instance [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:19:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-92f2b280-08a1-4537-9627-2cb4b94c1e25 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.724s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:12 user nova-compute[75257]: INFO nova.compute.manager [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Detaching volume 97417f33-08c2-4f70-ba3e-d5a6ff297411
Nov 14 02:19:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:12 user nova-compute[75257]: INFO nova.virt.block_device [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Attempting to driver detach volume 97417f33-08c2-4f70-ba3e-d5a6ff297411 from mountpoint /dev/vdc
Nov 14 02:19:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Attempting to detach device vdc from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:19:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:19:12 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:19:12 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:19:12 user nova-compute[75257]:   <target dev="vdc" bus="virtio"/>
Nov 14 02:19:12 user nova-compute[75257]:   <serial>97417f33-08c2-4f70-ba3e-d5a6ff297411</serial>
Nov 14 02:19:12 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 02:19:12 user nova-compute[75257]: </disk>
Nov 14 02:19:12 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:19:12 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully detached device vdc from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 from the persistent domain config.
Nov 14 02:19:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:19:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:19:12 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:19:12 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:19:12 user nova-compute[75257]:   <target dev="vdc" bus="virtio"/>
Nov 14 02:19:12 user nova-compute[75257]:   <serial>97417f33-08c2-4f70-ba3e-d5a6ff297411</serial>
Nov 14 02:19:12 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 02:19:12 user nova-compute[75257]: </disk>
Nov 14 02:19:12 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:19:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:19:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'flavor' on Instance uuid 9e083a62-27d0-4633-a608-7eb34ddafe2c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:19:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:14 user nova-compute[75257]: INFO nova.compute.manager [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Attaching volume 006829f8-9e9b-4d9a-a76a-ed873c5b57fb to /dev/vdb
Nov 14 02:19:14 user nova-compute[75257]: DEBUG os_brick.utils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a358e9-afe2-409f-913d-3acd3046da1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6d136c-e40d-4669-af19-30deced0c349]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e21b1a1-945a-411b-84ad-7b308ecb0dac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9a243f-e0c5-4602-972e-8969ffd60941]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:19:14 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:19:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[16058830-20ee-4fb5-bf81-520e9a478529]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG os_brick.utils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:19:14 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updating existing volume attachment record: e32a478e-4681-4784-8544-6d4f060319a2 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:19:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received event network-changed-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Refreshing instance network info cache due to event network-changed-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:19:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] Acquiring lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] Acquired lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:15 user nova-compute[75257]: DEBUG nova.network.neutron [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Refreshing network info cache for port 305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:19:15 user nova-compute[75257]: DEBUG nova.network.neutron [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updated VIF entry in instance network info cache for port 305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:19:15 user nova-compute[75257]: DEBUG nova.network.neutron [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updating instance_info_cache with network_info: [{"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-284ae149-a6b1-47ac-b056-7f7f79d2bcb4 req-b1f0f41f-e0e4-45de-9c8e-37cb403889a5 service nova] Releasing lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Stashing vm_state: active {{(pid=75257) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 02:19:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:16 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:19:16 user nova-compute[75257]: INFO nova.compute.claims [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Claim successful on node user
Nov 14 02:19:16 user nova-compute[75257]: INFO nova.compute.resource_tracker [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating resource usage from migration f32320a7-249a-4d70-b8f5-d6a88922f6a2
Nov 14 02:19:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-changed-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Refreshing instance network info cache due to event network-changed-36f42e8b-2ba5-49e9-9966-67431aed797f. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] Acquiring lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] Acquired lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Refreshing network info cache for port 36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.513s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:17 user nova-compute[75257]: INFO nova.compute.manager [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Migrating
Nov 14 02:19:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updated VIF entry in instance network info cache for port 36f42e8b-2ba5-49e9-9966-67431aed797f. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating instance_info_cache with network_info: [{"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-169b1993-debe-46fa-bff2-66dd3b413c7d req-9d217fb7-461f-4d38-8469-da9f777819b2 service nova] Releasing lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquired lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating instance_info_cache with network_info: [{"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Releasing lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Starting migrate_disk_and_power_off {{(pid=75257) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-unplugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] No waiting events found dispatching network-vif-unplugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:18 user nova-compute[75257]: WARNING nova.compute.manager [req-61ea3157-63a2-4ad5-a354-2a44259c0fec req-7ff59536-62c4-4aa6-a49d-aaf6908be54c service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received unexpected event network-vif-unplugged-36f42e8b-2ba5-49e9-9966-67431aed797f for instance with vm_state active and task_state resize_migrating.
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Instance destroyed successfully.
Nov 14 02:19:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1977700667',display_name='tempest-ServerActionsTestOtherA-server-1977700667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1977700667',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww==',key_name='tempest-keypair-1627475945',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-jhpchxnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=90d8b16a-a1f1-4625-a715-e5e8bd87d66b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1017750038-network", "vif_mac": "fa:16:3e:a8:b7:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1017750038-network", "vif_mac": "fa:16:3e:a8:b7:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_vif [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36f42e8b-2b, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b95a1a6c-e71d-4f77-b50f-a13209b64bbf) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:18 user nova-compute[75257]: INFO os_vif [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b')
Nov 14 02:19:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcdzUPrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:19:18 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8259d3-4b6b-4325-b3ec-e99b80c4272c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:19:18 user nova-compute[75257]: No targets found.
Nov 14 02:19:18 user nova-compute[75257]: iSNS:
Nov 14 02:19:18 user nova-compute[75257]: No targets found.
Nov 14 02:19:18 user nova-compute[75257]: STATIC:
Nov 14 02:19:18 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:19:18 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:18 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:18 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112
Nov 14 02:19:18 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:18 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:18 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:19:18 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:18 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:18 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:19:18 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:18 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:18 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411
Nov 14 02:19:18 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:18 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:18 user nova-compute[75257]: FIRMWARE:
Nov 14 02:19:18 user nova-compute[75257]: No targets found.
Nov 14 02:19:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:19:18 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:19:18 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6a6d5d-4d6c-4803-a841-5e2827cbacf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[904758fa-b173-4f9d-b054-a4910885a475]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:18 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:19:18 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:18 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:18 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:18 user nova-compute[75257]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:19:18 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:18 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:18 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3b01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:19:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd10441-0f7c-42e6-9a4d-3ff92e20ebc0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b87f27c-81ca-4c5d-8289-9f18cdc50821]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f460af-3095-4172-9791-3dfe74647f23]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fe9b5e-685f-4e9f-a558-066c061fc143]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8ebcc07e', '/dev/disk/by-id/scsi-1SCST_BIO8ebcc07e-2d1adcef90579cc8', '/dev/disk/by-id/scsi-23264316164636566') {{(pid=85764) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa89cad-b9f4-4a0e-a050-a935d138e28a]: (4, None) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7ab0fb-8c3b-46d0-a0b6-462049bc111b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb10f8c-670e-43cc-95f3-b8c15ae825ac]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260]
Nov 14 02:19:19 user nova-compute[75257]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260] successful.
Nov 14 02:19:19 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c3c679-d872-4079-8fd2-1d3c7022e42a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== disconnect_volume: return (383ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:19:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] No waiting events found dispatching network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:20 user nova-compute[75257]: WARNING nova.compute.manager [req-b254b7a1-b228-4e5d-a570-5872c37a316f req-b049bb5a-dd7a-44be-a62c-b862899ed4fb service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received unexpected event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f for instance with vm_state active and task_state resize_migrating.
Nov 14 02:19:20 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Port 36f42e8b-2ba5-49e9-9966-67431aed797f binding to destination host user is already ACTIVE {{(pid=75257) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMtPQBWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:19:20 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:19:20 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:19:20 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[372233e7-6c97-43ea-919e-2e96ff688196]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:19:20 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa05c956-599f-49ee-ae6e-6a31b8b190ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb] added
Nov 14 02:19:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a802ce49-bc55-4254-980c-d38e8a4a93dd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquired lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b00593-809b-4cb3-b6fc-e0885c9356ce]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FMtPQBWi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FMtPQBWi" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1a2544-2aa4-4d9a-a0f4-d5c6fd20d062]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FMtPQBWi'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aefa0fb-263f-43a3-b595-75f74f460797]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0532af49-395a-49e3-a897-a991b42fd513]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:20 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:20 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:20 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:20 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:20 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:20 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1f1c61-8221-4d44-b621-bac281603f29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb, portal: 172.16.0.220,3260]
Nov 14 02:19:20 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb, portal: 172.16.0.220,3260] successful.
Nov 14 02:19:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad7cf4b-b911-4e3d-a99e-3a6b0ef4eacb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[589cf0a7-2c77-4d12-a9b4-a0c0d4932a54]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:21 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:21 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:21 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:21 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:19:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:21 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:21 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:21 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:21 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:19:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f640168a-f6b2-492e-8fb0-899c985e543e]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating instance_info_cache with network_info: [{"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Releasing lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.utils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7009f563-6cb6-4675-85c4-089c21d79d3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2779e51-5982-4350-9e88-f4dfde905288]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[715ca389-2340-450d-802f-a1d41404270a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0995b8dc-78b6-41ac-8bed-851bf0aabded]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:19:21 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:19:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e3e575-2ffa-4b3c-8a9a-48aee02d64cc]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:19:21 user nova-compute[75257]: DEBUG os_brick.utils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMtPQBWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26664383066666632', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664383066666632', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG nova.objects.instance [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'flavor' on Instance uuid 9e083a62-27d0-4633-a608-7eb34ddafe2c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:19:22 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:19:22 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:19:22 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:19:22 user nova-compute[75257]:   <serial>006829f8-9e9b-4d9a-a76a-ed873c5b57fb</serial>
Nov 14 02:19:22 user nova-compute[75257]: </disk>
Nov 14 02:19:22 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] No VIF found with MAC fa:16:3e:4d:0d:51, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:19:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-af1e8fc0-8753-42d6-acf8-17a4548c4485 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.543s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing instance network info cache due to event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:19:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] Acquiring lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] Acquired lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:25 user nova-compute[75257]: DEBUG nova.network.neutron [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:19:25 user nova-compute[75257]: DEBUG nova.network.neutron [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updated VIF entry in instance network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:19:25 user nova-compute[75257]: DEBUG nova.network.neutron [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updating instance_info_cache with network_info: [{"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1cb8cb0c-0881-4e83-89ab-06704eb6b95a req-0db40206-9971-4c4c-8f44-45a52c46a477 service nova] Releasing lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Starting finish_migration {{(pid=75257) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Instance directory exists: not creating {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 02:19:26 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Creating image(s)
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Ensure instance console log exists: /opt/stack/data/nova/instances/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Start _get_guest_xml network_info=[{"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1017750038-network", "vif_mac": "fa:16:3e:a8:b7:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3f84f501-58cb-4b58-a9dc-c68c425e7c53', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcdzUPrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '90d8b16a-a1f1-4625-a715-e5e8bd87d66b', 'attached_at': '2023-11-14T02:19:26.000000', 'detached_at': '', 'volume_id': 'bfe732f2-6802-4277-9e26-6ee51b70df83', 'serial': 'bfe732f2-6802-4277-9e26-6ee51b70df83'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:19:26 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:19:26 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcdzUPrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:19:26 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:19:26 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:19:26 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb456f9a-34f7-4ebd-a43f-d7ab81c0634f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:19:26 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17c937c-a6aa-4baf-af38-dc692beee632]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83] added
Nov 14 02:19:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a492cc00-baf6-458d-95ca-bedbd20f0b62]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7204d4e2-89d1-4acb-a9ca-8c2cac844f4d]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcdzUPrq {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcdzUPrq" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a97bc70-0a19-46ff-9b46-aac54ad20945]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZcdzUPrq'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c3512-a369-49e2-9fd8-8158a7b51de2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[10614320-dbc2-4e0a-830b-552ecd828b58]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:19:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:19:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66cc19d-4550-4fad-9efc-70d6c0035de3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260]
Nov 14 02:19:26 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260] successful.
Nov 14 02:19:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.068s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff46d9d2-6631-4ac0-b5fa-50e48afc04df]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b83cca-85ca-4191-801f-8f19f567123a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:19:26 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:19:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe0e8f-5905-4e65-8e90-440201e792ab]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:19:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcdzUPrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing instance network info cache due to event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] Acquiring lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] Acquired lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.network.neutron [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23264316164636566', 'path': '/dev/sdf'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264316164636566', 'path': '/dev/sdf'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1977700667',display_name='tempest-ServerActionsTestOtherA-server-1977700667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1977700667',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww==',key_name='tempest-keypair-1627475945',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-jhpchxnl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:19:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=90d8b16a-a1f1-4625-a715-e5e8bd87d66b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1017750038-network", "vif_mac": "fa:16:3e:a8:b7:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1017750038-network", "vif_mac": "fa:16:3e:a8:b7:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:19:27 user nova-compute[75257]:   <uuid>90d8b16a-a1f1-4625-a715-e5e8bd87d66b</uuid>
Nov 14 02:19:27 user nova-compute[75257]:   <name>instance-0000001e</name>
Nov 14 02:19:27 user nova-compute[75257]:   <memory>2097152</memory>
Nov 14 02:19:27 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:19:27 user nova-compute[75257]:   <metadata>
Nov 14 02:19:27 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:19:27 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:19:27 user nova-compute[75257]:       <nova:name>tempest-ServerActionsTestOtherA-server-1977700667</nova:name>
Nov 14 02:19:27 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:19:26</nova:creationTime>
Nov 14 02:19:27 user nova-compute[75257]:       <nova:flavor name="m1.small">
Nov 14 02:19:27 user nova-compute[75257]:         <nova:memory>2048</nova:memory>
Nov 14 02:19:27 user nova-compute[75257]:         <nova:disk>20</nova:disk>
Nov 14 02:19:27 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:19:27 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:19:27 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:19:27 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:19:27 user nova-compute[75257]:       <nova:owner>
Nov 14 02:19:27 user nova-compute[75257]:         <nova:user uuid="7ffa5574e531479993ef301510f1d9e3">tempest-ServerActionsTestOtherA-1988221692-project-member</nova:user>
Nov 14 02:19:27 user nova-compute[75257]:         <nova:project uuid="a1ba9547629f4ea1b40424e277e17d25">tempest-ServerActionsTestOtherA-1988221692</nova:project>
Nov 14 02:19:27 user nova-compute[75257]:       </nova:owner>
Nov 14 02:19:27 user nova-compute[75257]:       <nova:ports>
Nov 14 02:19:27 user nova-compute[75257]:         <nova:port uuid="36f42e8b-2ba5-49e9-9966-67431aed797f">
Nov 14 02:19:27 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 02:19:27 user nova-compute[75257]:         </nova:port>
Nov 14 02:19:27 user nova-compute[75257]:       </nova:ports>
Nov 14 02:19:27 user nova-compute[75257]:     </nova:instance>
Nov 14 02:19:27 user nova-compute[75257]:   </metadata>
Nov 14 02:19:27 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:19:27 user nova-compute[75257]:     <system>
Nov 14 02:19:27 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:19:27 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:19:27 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:19:27 user nova-compute[75257]:       <entry name="serial">90d8b16a-a1f1-4625-a715-e5e8bd87d66b</entry>
Nov 14 02:19:27 user nova-compute[75257]:       <entry name="uuid">90d8b16a-a1f1-4625-a715-e5e8bd87d66b</entry>
Nov 14 02:19:27 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:19:27 user nova-compute[75257]:     </system>
Nov 14 02:19:27 user nova-compute[75257]:   </sysinfo>
Nov 14 02:19:27 user nova-compute[75257]:   <os>
Nov 14 02:19:27 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:19:27 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:19:27 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:19:27 user nova-compute[75257]:   </os>
Nov 14 02:19:27 user nova-compute[75257]:   <features>
Nov 14 02:19:27 user nova-compute[75257]:     <acpi/>
Nov 14 02:19:27 user nova-compute[75257]:     <apic/>
Nov 14 02:19:27 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:19:27 user nova-compute[75257]:   </features>
Nov 14 02:19:27 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:19:27 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:19:27 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:19:27 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:19:27 user nova-compute[75257]:   </clock>
Nov 14 02:19:27 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:19:27 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:19:27 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:19:27 user nova-compute[75257]:   </cpu>
Nov 14 02:19:27 user nova-compute[75257]:   <devices>
Nov 14 02:19:27 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:19:27 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:19:27 user nova-compute[75257]:       <source dev="/dev/sdf"/>
Nov 14 02:19:27 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:19:27 user nova-compute[75257]:       <serial>bfe732f2-6802-4277-9e26-6ee51b70df83</serial>
Nov 14 02:19:27 user nova-compute[75257]:     </disk>
Nov 14 02:19:27 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:19:27 user nova-compute[75257]:       <mac address="fa:16:3e:a8:b7:c9"/>
Nov 14 02:19:27 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:19:27 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:19:27 user nova-compute[75257]:       <target dev="tap36f42e8b-2b"/>
Nov 14 02:19:27 user nova-compute[75257]:     </interface>
Nov 14 02:19:27 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:19:27 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/90d8b16a-a1f1-4625-a715-e5e8bd87d66b/console.log" append="off"/>
Nov 14 02:19:27 user nova-compute[75257]:     </serial>
Nov 14 02:19:27 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:19:27 user nova-compute[75257]:     <video>
Nov 14 02:19:27 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:19:27 user nova-compute[75257]:     </video>
Nov 14 02:19:27 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:19:27 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:19:27 user nova-compute[75257]:     </rng>
Nov 14 02:19:27 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:19:27 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:19:27 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:19:27 user nova-compute[75257]:     </memballoon>
Nov 14 02:19:27 user nova-compute[75257]:   </devices>
Nov 14 02:19:27 user nova-compute[75257]: </domain>
Nov 14 02:19:27 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1977700667',display_name='tempest-ServerActionsTestOtherA-server-1977700667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1977700667',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww==',key_name='tempest-keypair-1627475945',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-jhpchxnl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:19:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=90d8b16a-a1f1-4625-a715-e5e8bd87d66b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1017750038-network", "vif_mac": "fa:16:3e:a8:b7:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1017750038-network", "vif_mac": "fa:16:3e:a8:b7:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG os_vif [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82debb31-7614-57f9-b4a6-402d397b8016', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36f42e8b-2b, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36f42e8b-2b, col_values=(('qos', UUID('56016099-e627-4801-8495-ea954af102d9')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36f42e8b-2b, col_values=(('external_ids', {'iface-id': '36f42e8b-2ba5-49e9-9966-67431aed797f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:b7:c9', 'vm-uuid': '90d8b16a-a1f1-4625-a715-e5e8bd87d66b'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:19:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:27 user nova-compute[75257]: INFO os_vif [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b')
Nov 14 02:19:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] No VIF found with MAC fa:16:3e:a8:b7:c9, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG nova.network.neutron [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updated VIF entry in instance network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG nova.network.neutron [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updating instance_info_cache with network_info: [{"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:28 user nova-compute[75257]: INFO nova.compute.manager [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Rebooting instance
Nov 14 02:19:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1be65648-9229-44de-a93b-d16b9871cb60 req-2233e228-6772-4580-b0f7-f9e73d4dce0a service nova] Releasing lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquired lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updating instance_info_cache with network_info: [{"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Releasing lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:19:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] No waiting events found dispatching network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:29 user nova-compute[75257]: WARNING nova.compute.manager [req-eba53b77-a839-4701-9fd0-0c11c6dab4c1 req-00feeef9-b7be-4f4e-a021-cbf564ba837c service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received unexpected event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f for instance with vm_state active and task_state resize_finish.
Nov 14 02:19:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:19:31 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Instance running successfully.
Nov 14 02:19:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Failed to set time: agent not configured {{(pid=75257) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e57b4442-439d-419e-bf37-71c58471d11e tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] finish_migration finished successfully. {{(pid=75257) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] No waiting events found dispatching network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:31 user nova-compute[75257]: WARNING nova.compute.manager [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received unexpected event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f for instance with vm_state active and task_state resize_finish.
Nov 14 02:19:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-unplugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-unplugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:31 user nova-compute[75257]: WARNING nova.compute.manager [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-unplugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state active and task_state reboot_started.
Nov 14 02:19:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:31 user nova-compute[75257]: WARNING nova.compute.manager [req-96dabfc5-4d2f-4d29-a684-54149d873df7 req-94f0d1d1-ccfe-451d-b91b-7f883861afbe service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state active and task_state reboot_started.
Nov 14 02:19:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:31 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Instance shutdown successfully.
Nov 14 02:19:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:32 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 is timed out.
Nov 14 02:19:32 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully detached device vdc from instance 8487e985-c0d1-4bbd-9c28-c3312d737285 from the live domain config.
Nov 14 02:19:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fzVcmDbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:19:32 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ade77e6-f031-45e1-b619-1424e6c8f412]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:19:32 user nova-compute[75257]: No targets found.
Nov 14 02:19:32 user nova-compute[75257]: iSNS:
Nov 14 02:19:32 user nova-compute[75257]: No targets found.
Nov 14 02:19:32 user nova-compute[75257]: STATIC:
Nov 14 02:19:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:19:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112
Nov 14 02:19:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:19:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:19:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411
Nov 14 02:19:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:32 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb
Nov 14 02:19:32 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:19:32 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:19:32 user nova-compute[75257]: FIRMWARE:
Nov 14 02:19:32 user nova-compute[75257]: No targets found.
Nov 14 02:19:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:19:32 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:19:32 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[593d02b0-9fce-491f-bd52-d38c553fca4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8465c0c-8003-4ee6-8a6c-bdedeabbc5b5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:19:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:19:32 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:19:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c11a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8338bdf4-04df-4f5a-9347-b082892c71b1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccfc923-0761-488e-8465-dad409c2ca81]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5805d8-3ca9-49d8-9294-61531aafc054]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7300b76-d483-4ec8-9e8e-c6f735259de1]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac056aed-fcc8-4b4d-ad84-8be16d995cb9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d46daf-e9af-44f3-8d50-e6a782591509]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411, portal: 172.16.0.220,3260]
Nov 14 02:19:32 user nova-compute[75257]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411, portal: 172.16.0.220,3260] successful.
Nov 14 02:19:32 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97417f33-08c2-4f70-ba3e-d5a6ff297411 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25ca1ae-f457-444f-89c7-8163698c54a0]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:32 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] <== disconnect_volume: return (334ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG nova.compute.manager [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG nova.compute.manager [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:33 user nova-compute[75257]: WARNING nova.compute.manager [req-11d67a84-902f-49c6-a331-87ee904f79a8 req-a81e2b03-c1c5-4157-8eb6-9ec375bd6080 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state active and task_state reboot_started.
Nov 14 02:19:33 user nova-compute[75257]: DEBUG nova.objects.instance [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'flavor' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3762da16-bed9-4ffb-a07c-d2c7cea26e52 tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:35 user nova-compute[75257]: INFO nova.compute.manager [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Terminating instance
Nov 14 02:19:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Instance running successfully.
Nov 14 02:19:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Instance soft rebooted successfully.
Nov 14 02:19:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ce0a178c-e89c-4549-982b-c0dba8e22db6 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.538s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:35 user nova-compute[75257]: WARNING nova.compute.manager [req-14bfac39-e5a6-44e4-ac6d-759898c591d5 req-99fb3699-3efd-4718-9c20-929e4512f85c service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state active and task_state None.
Nov 14 02:19:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-unplugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] No waiting events found dispatching network-vif-unplugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-1f8df975-8dd0-4bd9-917a-04d53b200419 req-0a7cae87-0447-4c80-8ec9-cf0cbb3e2b57 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-unplugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Instance destroyed successfully.
Nov 14 02:19:36 user nova-compute[75257]: DEBUG nova.objects.instance [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lazy-loading 'resources' on Instance uuid 8487e985-c0d1-4bbd-9c28-c3312d737285 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:16:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1593989199',display_name='tempest-AttachVolumeTestJSON-server-1593989199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1593989199',id=28,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hcSFq1FeMc+GFWewz+4DRO7u7cjYp28OdGpahF+Hv7z4eE0Gq7BOF5NGS5EG3kUCI/UqJLtdXnEI+nJsZqRsbH4dAS6d/Sj3fx3XI2oXIUZ5Y1xduDxKEsMyUiNoEIw==',key_name='tempest-keypair-2103484389',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='246dd4dc2106412bb0ca5e71670d9557',ramdisk_id='',reservation_id='r-h85ie8hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1670713184',owner_user_name='tempest-AttachVolumeTestJSON-1670713184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4002c20dcbc94a8ea540419f20f8621e',uuid=8487e985-c0d1-4bbd-9c28-c3312d737285,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converting VIF {"id": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "address": "fa:16:3e:ce:02:34", "network": {"id": "2e565fc0-c932-4f99-84ef-b157a352b43c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1082274166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "246dd4dc2106412bb0ca5e71670d9557", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae70a55-08", "ovs_interfaceid": "8ae70a55-08c9-43dd-9982-4f97e0b19ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:02:34,bridge_name='br-int',has_traffic_filtering=True,id=8ae70a55-08c9-43dd-9982-4f97e0b19ea2,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae70a55-08') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG os_vif [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:02:34,bridge_name='br-int',has_traffic_filtering=True,id=8ae70a55-08c9-43dd-9982-4f97e0b19ea2,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae70a55-08') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ae70a55-08, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=286a25c8-cf17-4e2e-bd92-765f6f4431ec) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:19:36 user nova-compute[75257]: INFO os_vif [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:02:34,bridge_name='br-int',has_traffic_filtering=True,id=8ae70a55-08c9-43dd-9982-4f97e0b19ea2,network=Network(2e565fc0-c932-4f99-84ef-b157a352b43c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae70a55-08')
Nov 14 02:19:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Deleting instance files /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285_del
Nov 14 02:19:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Deletion of /opt/stack/data/nova/instances/8487e985-c0d1-4bbd-9c28-c3312d737285_del complete
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: INFO nova.compute.manager [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 14 02:19:36 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-deleted-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:37 user nova-compute[75257]: INFO nova.compute.manager [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Neutron deleted interface 8ae70a55-08c9-43dd-9982-4f97e0b19ea2; detaching it from the instance and deleting it from the info cache
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.network.neutron [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:37 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Took 0.85 seconds to deallocate network for instance.
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-3c66dc79-6310-4791-9342-ee126ca49e59 req-fbf59942-1e32-45d4-8914-f0e8ca2fe48b service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Detach interface failed, port_id=8ae70a55-08c9-43dd-9982-4f97e0b19ea2, reason: Instance 8487e985-c0d1-4bbd-9c28-c3312d737285 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:37 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Deleted allocations for instance 8487e985-c0d1-4bbd-9c28-c3312d737285
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] No waiting events found dispatching network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:37 user nova-compute[75257]: WARNING nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received unexpected event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance with vm_state deleted and task_state None.
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] No waiting events found dispatching network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:37 user nova-compute[75257]: WARNING nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received unexpected event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance with vm_state deleted and task_state None.
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] No waiting events found dispatching network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:37 user nova-compute[75257]: WARNING nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received unexpected event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance with vm_state deleted and task_state None.
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-unplugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] No waiting events found dispatching network-vif-unplugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:37 user nova-compute[75257]: WARNING nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received unexpected event network-vif-unplugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance with vm_state deleted and task_state None.
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Acquiring lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] No waiting events found dispatching network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:37 user nova-compute[75257]: WARNING nova.compute.manager [req-5fe7cc68-8201-4dff-adcf-43b0a4771ca9 req-a98fc3de-4436-4545-b34f-3fcf183cda95 service nova] [instance: 8487e985-c0d1-4bbd-9c28-c3312d737285] Received unexpected event network-vif-plugged-8ae70a55-08c9-43dd-9982-4f97e0b19ea2 for instance with vm_state deleted and task_state None.
Nov 14 02:19:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-892f714f-c899-4680-acd1-fa0483d4d92c tempest-AttachVolumeTestJSON-1670713184 tempest-AttachVolumeTestJSON-1670713184-project-member] Lock "8487e985-c0d1-4bbd-9c28-c3312d737285" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.538s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Received event network-changed-3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Refreshing instance network info cache due to event network-changed-3f087bec-f4a3-4cc7-85a4-bbc27914cbae. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:19:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] Acquiring lock "refresh_cache-987991d7-8a45-49ee-a516-fac07e1d8589" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] Acquired lock "refresh_cache-987991d7-8a45-49ee-a516-fac07e1d8589" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:46 user nova-compute[75257]: DEBUG nova.network.neutron [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Refreshing network info cache for port 3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:19:46 user nova-compute[75257]: DEBUG nova.network.neutron [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Updated VIF entry in instance network info cache for port 3f087bec-f4a3-4cc7-85a4-bbc27914cbae. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:19:46 user nova-compute[75257]: DEBUG nova.network.neutron [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Updating instance_info_cache with network_info: [{"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a3f0940c-29d0-4dce-a3e5-a36822b79f94 req-c856ad04-61f1-45b1-acde-d39a075d5c92 service nova] Releasing lock "refresh_cache-987991d7-8a45-49ee-a516-fac07e1d8589" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:19:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:19:48 user nova-compute[75257]: INFO nova.compute.claims [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Claim successful on node user
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:19:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.policy [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:19:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Creating image(s)
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "/opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "/opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk 1073741824" returned: 0 in 0.064s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Successfully created port: 9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:19:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:50 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Cannot resize image /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:19:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:19:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Ensure instance console log exists: /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:19:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.neutron [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Successfully updated port: 9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "refresh_cache-ba9ecc12-fe4e-4124-8f4c-2160cd08337b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquired lock "refresh_cache-ba9ecc12-fe4e-4124-8f4c-2160cd08337b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.neutron [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received event network-changed-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Refreshing instance network info cache due to event network-changed-9f182a18-791f-4fba-b4b9-787664194dd7. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] Acquiring lock "refresh_cache-ba9ecc12-fe4e-4124-8f4c-2160cd08337b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.neutron [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.neutron [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Updating instance_info_cache with network_info: [{"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Releasing lock "refresh_cache-ba9ecc12-fe4e-4124-8f4c-2160cd08337b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Instance network_info: |[{"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] Acquired lock "refresh_cache-ba9ecc12-fe4e-4124-8f4c-2160cd08337b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Refreshing network info cache for port 9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Start _get_guest_xml network_info=[{"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:19:51 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:19:51 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:19:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1009716805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1009716805',id=33,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-ob75vpqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:19:49Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=ba9ecc12-fe4e-4124-8f4c-2160cd08337b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=9f182a18-791f-4fba-b4b9-787664194dd7,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f182a18-79') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.objects.instance [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'pci_devices' on Instance uuid ba9ecc12-fe4e-4124-8f4c-2160cd08337b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:19:51 user nova-compute[75257]:   <uuid>ba9ecc12-fe4e-4124-8f4c-2160cd08337b</uuid>
Nov 14 02:19:51 user nova-compute[75257]:   <name>instance-00000021</name>
Nov 14 02:19:51 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:19:51 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:19:51 user nova-compute[75257]:   <metadata>
Nov 14 02:19:51 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:19:51 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:19:51 user nova-compute[75257]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1009716805</nova:name>
Nov 14 02:19:51 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:19:51</nova:creationTime>
Nov 14 02:19:51 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:19:51 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:19:51 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:19:51 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:19:51 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:19:51 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:19:51 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:19:51 user nova-compute[75257]:       <nova:owner>
Nov 14 02:19:51 user nova-compute[75257]:         <nova:user uuid="addcfdac50de4b03bd3ad3142508edea">tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member</nova:user>
Nov 14 02:19:51 user nova-compute[75257]:         <nova:project uuid="ac29176de8fc434285721bbb6759966d">tempest-ServerBootFromVolumeStableRescueTest-1355021813</nova:project>
Nov 14 02:19:51 user nova-compute[75257]:       </nova:owner>
Nov 14 02:19:51 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:19:51 user nova-compute[75257]:       <nova:ports>
Nov 14 02:19:51 user nova-compute[75257]:         <nova:port uuid="9f182a18-791f-4fba-b4b9-787664194dd7">
Nov 14 02:19:51 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 02:19:51 user nova-compute[75257]:         </nova:port>
Nov 14 02:19:51 user nova-compute[75257]:       </nova:ports>
Nov 14 02:19:51 user nova-compute[75257]:     </nova:instance>
Nov 14 02:19:51 user nova-compute[75257]:   </metadata>
Nov 14 02:19:51 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:19:51 user nova-compute[75257]:     <system>
Nov 14 02:19:51 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:19:51 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:19:51 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:19:51 user nova-compute[75257]:       <entry name="serial">ba9ecc12-fe4e-4124-8f4c-2160cd08337b</entry>
Nov 14 02:19:51 user nova-compute[75257]:       <entry name="uuid">ba9ecc12-fe4e-4124-8f4c-2160cd08337b</entry>
Nov 14 02:19:51 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:19:51 user nova-compute[75257]:     </system>
Nov 14 02:19:51 user nova-compute[75257]:   </sysinfo>
Nov 14 02:19:51 user nova-compute[75257]:   <os>
Nov 14 02:19:51 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:19:51 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:19:51 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:19:51 user nova-compute[75257]:   </os>
Nov 14 02:19:51 user nova-compute[75257]:   <features>
Nov 14 02:19:51 user nova-compute[75257]:     <acpi/>
Nov 14 02:19:51 user nova-compute[75257]:     <apic/>
Nov 14 02:19:51 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:19:51 user nova-compute[75257]:   </features>
Nov 14 02:19:51 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:19:51 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:19:51 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:19:51 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:19:51 user nova-compute[75257]:   </clock>
Nov 14 02:19:51 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:19:51 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:19:51 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:19:51 user nova-compute[75257]:   </cpu>
Nov 14 02:19:51 user nova-compute[75257]:   <devices>
Nov 14 02:19:51 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:19:51 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:19:51 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk"/>
Nov 14 02:19:51 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:19:51 user nova-compute[75257]:     </disk>
Nov 14 02:19:51 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:19:51 user nova-compute[75257]:       <mac address="fa:16:3e:18:d1:85"/>
Nov 14 02:19:51 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:19:51 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:19:51 user nova-compute[75257]:       <target dev="tap9f182a18-79"/>
Nov 14 02:19:51 user nova-compute[75257]:     </interface>
Nov 14 02:19:51 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:19:51 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/console.log" append="off"/>
Nov 14 02:19:51 user nova-compute[75257]:     </serial>
Nov 14 02:19:51 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:19:51 user nova-compute[75257]:     <video>
Nov 14 02:19:51 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:19:51 user nova-compute[75257]:     </video>
Nov 14 02:19:51 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:19:51 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:19:51 user nova-compute[75257]:     </rng>
Nov 14 02:19:51 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:19:51 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:19:51 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:19:51 user nova-compute[75257]:     </memballoon>
Nov 14 02:19:51 user nova-compute[75257]:   </devices>
Nov 14 02:19:51 user nova-compute[75257]: </domain>
Nov 14 02:19:51 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:19:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1009716805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1009716805',id=33,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-ob75vpqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:19:49Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=ba9ecc12-fe4e-4124-8f4c-2160cd08337b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=9f182a18-791f-4fba-b4b9-787664194dd7,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f182a18-79') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG os_vif [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=9f182a18-791f-4fba-b4b9-787664194dd7,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f182a18-79') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec66ec2d-3fea-50d0-9be3-631cf5f8a39d', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f182a18-79, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f182a18-79, col_values=(('qos', UUID('81c44d04-2316-49d3-9b64-09012d428a19')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f182a18-79, col_values=(('external_ids', {'iface-id': '9f182a18-791f-4fba-b4b9-787664194dd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:d1:85', 'vm-uuid': 'ba9ecc12-fe4e-4124-8f4c-2160cd08337b'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:51 user nova-compute[75257]: INFO os_vif [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=9f182a18-791f-4fba-b4b9-787664194dd7,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f182a18-79')
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No VIF found with MAC fa:16:3e:18:d1:85, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Updated VIF entry in instance network info cache for port 9f182a18-791f-4fba-b4b9-787664194dd7. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Updating instance_info_cache with network_info: [{"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8150d527-f28a-4046-81ff-263cedf8305b req-8118fc17-3b60-4b46-992a-1a74f57cce84 service nova] Releasing lock "refresh_cache-ba9ecc12-fe4e-4124-8f4c-2160cd08337b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "055ad398-aa12-4378-a63a-e2a3562f661e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "055ad398-aa12-4378-a63a-e2a3562f661e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:19:52 user nova-compute[75257]: INFO nova.compute.claims [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Claim successful on node user
Nov 14 02:19:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received event network-vif-plugged-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] Acquiring lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] No waiting events found dispatching network-vif-plugged-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:53 user nova-compute[75257]: WARNING nova.compute.manager [req-572fd95a-f0f4-498f-b2c7-d54291b60703 req-30fb289f-7296-497d-8c71-9cac3a341f4b service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received unexpected event network-vif-plugged-9f182a18-791f-4fba-b4b9-787664194dd7 for instance with vm_state building and task_state spawning.
Nov 14 02:19:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:19:53 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:19:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:19:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:19:53 user nova-compute[75257]: INFO nova.virt.block_device [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Booting with volume snapshot b0c43ae3-281c-424f-94ca-013918479196 at /dev/vda
Nov 14 02:19:53 user nova-compute[75257]: DEBUG nova.policy [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:19:54 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Successfully created port: 8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:19:54 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Successfully updated port: 8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "refresh_cache-055ad398-aa12-4378-a63a-e2a3562f661e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquired lock "refresh_cache-055ad398-aa12-4378-a63a-e2a3562f661e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received event network-vif-plugged-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Acquiring lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] No waiting events found dispatching network-vif-plugged-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:55 user nova-compute[75257]: WARNING nova.compute.manager [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received unexpected event network-vif-plugged-9f182a18-791f-4fba-b4b9-787664194dd7 for instance with vm_state building and task_state spawning.
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received event network-changed-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Refreshing instance network info cache due to event network-changed-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Acquiring lock "refresh_cache-055ad398-aa12-4378-a63a-e2a3562f661e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Updating instance_info_cache with network_info: [{"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Releasing lock "refresh_cache-055ad398-aa12-4378-a63a-e2a3562f661e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Instance network_info: |[{"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Acquired lock "refresh_cache-055ad398-aa12-4378-a63a-e2a3562f661e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Refreshing network info cache for port 8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:19:55 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Instance spawned successfully.
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:19:55 user nova-compute[75257]: INFO nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:19:55 user nova-compute[75257]: INFO nova.compute.manager [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Took 6.99 seconds to build instance.
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fbf53715-9725-4c9d-b543-79ce46d1cca1 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.079s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Updated VIF entry in instance network info cache for port 8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG nova.network.neutron [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Updating instance_info_cache with network_info: [{"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e80c4093-b607-4b8c-baa4-c7ec0c6a7ad6 req-6d596ec0-e17b-4ad6-a40b-9f0ec36c314a service nova] Releasing lock "refresh_cache-055ad398-aa12-4378-a63a-e2a3562f661e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG nova.compute.manager [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received event network-changed-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG nova.compute.manager [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Refreshing instance network info cache due to event network-changed-4f86002d-ead3-4d58-be50-4e1d2c09896a. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] Acquiring lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] Acquired lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG nova.network.neutron [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Refreshing network info cache for port 4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:56 user nova-compute[75257]: INFO nova.compute.manager [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Terminating instance
Nov 14 02:19:56 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG nova.network.neutron [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Updated VIF entry in instance network info cache for port 4f86002d-ead3-4d58-be50-4e1d2c09896a. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG nova.network.neutron [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Updating instance_info_cache with network_info: [{"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e40a1b03-ff24-43bf-b292-c11c6b4757c6 req-77f5aa8b-69ad-4fbb-99da-c2803f4d230f service nova] Releasing lock "refresh_cache-c226a1bf-4b89-49e0-ad8f-149849f12639" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:19:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Instance destroyed successfully.
Nov 14 02:19:57 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lazy-loading 'resources' on Instance uuid c226a1bf-4b89-49e0-ad8f-149849f12639 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-887301658',display_name='tempest-TestStampPattern-server-887301658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-887301658',id=22,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA29cl1fr1mQddCmz0NjRlHZtGI31Z/HpB+Nsx3OGKzEmi6USs0zIOlWO+VML9vORCyVCO+2Wn/r9l3Z21RvN0BLUGIBRfBmYCbzP7P30tWvVkVZygqVIesWMX0qe0GeCw==',key_name='tempest-TestStampPattern-863039138',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbfae642569847a2a3ac4cd4066aeb22',ramdisk_id='',reservation_id='r-j3q7vgjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1994748770',owner_user_name='tempest-TestStampPattern-1994748770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:16:06Z,user_data=None,user_id='089b000c028b46b998f2c128a6cf3d0a',uuid=c226a1bf-4b89-49e0-ad8f-149849f12639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converting VIF {"id": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "address": "fa:16:3e:39:61:93", "network": {"id": "3cb79e37-ec0c-4195-8ad1-f968e55a48dd", "bridge": "br-int", "label": "tempest-TestStampPattern-435756778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfae642569847a2a3ac4cd4066aeb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f86002d-ea", "ovs_interfaceid": "4f86002d-ead3-4d58-be50-4e1d2c09896a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:61:93,bridge_name='br-int',has_traffic_filtering=True,id=4f86002d-ead3-4d58-be50-4e1d2c09896a,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f86002d-ea') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG os_vif [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:61:93,bridge_name='br-int',has_traffic_filtering=True,id=4f86002d-ead3-4d58-be50-4e1d2c09896a,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f86002d-ea') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f86002d-ea, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1c36ea6-f2ea-4d76-804a-f21b40611c2a) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:19:57 user nova-compute[75257]: INFO os_vif [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:61:93,bridge_name='br-int',has_traffic_filtering=True,id=4f86002d-ead3-4d58-be50-4e1d2c09896a,network=Network(3cb79e37-ec0c-4195-8ad1-f968e55a48dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f86002d-ea')
Nov 14 02:19:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Deleting instance files /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639_del
Nov 14 02:19:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Deletion of /opt/stack/data/nova/instances/c226a1bf-4b89-49e0-ad8f-149849f12639_del complete
Nov 14 02:19:57 user nova-compute[75257]: INFO nova.compute.manager [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 02:19:57 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:19:57 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:19:58 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Took 0.47 seconds to deallocate network for instance.
Nov 14 02:19:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-35e44daa-9b63-4192-968b-374a9a13ba9b req-97e280ae-7dc3-46e1-8376-10d2adff2666 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received event network-vif-deleted-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:19:58 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Deleted allocations for instance c226a1bf-4b89-49e0-ad8f-149849f12639
Nov 14 02:19:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received event network-vif-unplugged-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] No waiting events found dispatching network-vif-unplugged-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:58 user nova-compute[75257]: WARNING nova.compute.manager [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received unexpected event network-vif-unplugged-4f86002d-ead3-4d58-be50-4e1d2c09896a for instance with vm_state deleted and task_state None.
Nov 14 02:19:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received event network-vif-plugged-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Acquiring lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] No waiting events found dispatching network-vif-plugged-4f86002d-ead3-4d58-be50-4e1d2c09896a {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:19:58 user nova-compute[75257]: WARNING nova.compute.manager [req-4318c5ea-fc25-46fd-9619-e4290aed85cd req-5cd9c354-cfff-4c5c-839a-eb3e64aa9a50 service nova] [instance: c226a1bf-4b89-49e0-ad8f-149849f12639] Received unexpected event network-vif-plugged-4f86002d-ead3-4d58-be50-4e1d2c09896a for instance with vm_state deleted and task_state None.
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7fa438fd-4585-4cc3-9d0a-e23d4166749e tempest-TestStampPattern-1994748770 tempest-TestStampPattern-1994748770-project-member] Lock "c226a1bf-4b89-49e0-ad8f-149849f12639" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:19:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG os_brick.utils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e68f283-50dc-466d-ad05-b982c4620928]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2b3a91-42a1-4417-aa1a-5b1d1194cbb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa1144d-7706-4d32-bc67-16f68cdf7035]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0476b0-1744-4604-b240-7a3261d0b06a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:19:59 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5967b6e-823a-4806-8ace-c2fa74cb9402]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG os_brick.utils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Updating existing volume attachment record: 2b750b66-eaba-48a4-af68-d2ca7d3f8151 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:19:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:20:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:20:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7305MB free_disk=25.095367431640625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Applying migration context for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b as it has an incoming, in-progress migration f32320a7-249a-4d70-b8f5-d6a88922f6a2. Migration status is finished {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 02:20:03 user nova-compute[75257]: INFO nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating resource usage from migration f32320a7-249a-4d70-b8f5-d6a88922f6a2
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 9e083a62-27d0-4633-a608-7eb34ddafe2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 987991d7-8a45-49ee-a516-fac07e1d8589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Migration f32320a7-249a-4d70-b8f5-d6a88922f6a2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 055ad398-aa12-4378-a63a-e2a3562f661e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:20:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:20:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Creating image(s)
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Ensure instance console log exists: /opt/stack/data/nova/instances/055ad398-aa12-4378-a63a-e2a3562f661e/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Start _get_guest_xml network_info=[{"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T02:19:48Z,direct_url=<?>,disk_format='qcow2',id=7ec1582b-bd06-4bd6-ad74-b5cfd1ffd97b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1050006547',owner='6e49d1cf0a1c457ab943ffd360f1c3da',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T02:19:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2b750b66-eaba-48a4-af68-d2ca7d3f8151', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epRvDTUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '055ad398-aa12-4378-a63a-e2a3562f661e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd4a26c6-87c2-4029-b8d5-f9b810606ff5', 'serial': 'fd4a26c6-87c2-4029-b8d5-f9b810606ff5'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:20:04 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:20:04 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T02:19:48Z,direct_url=<?>,disk_format='qcow2',id=7ec1582b-bd06-4bd6-ad74-b5cfd1ffd97b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1050006547',owner='6e49d1cf0a1c457ab943ffd360f1c3da',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T02:19:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epRvDTUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:20:04 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:20:04 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:20:04 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0cfce8-150e-4517-869c-17dbdec3b9c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:20:04 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[03824398-94cd-4a8b-9c5f-9f7461909565]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5] added
Nov 14 02:20:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6087c8bd-04ee-4108-aabe-b11012605673]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e0b8fa-e96f-4e4c-973a-fd968b21331b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epRvDTUB {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epRvDTUB" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[035ea05c-682c-4666-aaaf-3d4afe2d7a93]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epRvDTUB'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Skipping network cache update for instance because it is Building. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f6b18e-7e96-4f41-9429-8218461d0068]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee22ae-0c2d-407b-a82d-8edaa9d757ff]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[82838601-3446-41aa-ba76-a602002139e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5, portal: 172.16.0.220,3260]
Nov 14 02:20:04 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5, portal: 172.16.0.220,3260] successful.
Nov 14 02:20:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d90cb25-f7cd-488b-8762-9db2348d4f60]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7aa711-8dd2-41d5-a543-2631fe326c76]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9380e4b-2a6b-462f-88fb-26bb142e1ebd]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:20:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epRvDTUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updating instance_info_cache with network_info: [{"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26630663264353864', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630663264353864', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-655354691',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-655354691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-655354691',id=34,image_ref='7ec1582b-bd06-4bd6-ad74-b5cfd1ffd97b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMfSbaIQjsDXUesX0QJMxpnjVwksnTpxHa42LE+eNaaAX/mAoIPiSgn1p7l9i13oPo6C0FpWOPz7OfXHeP0HYMXBBGYL0SUBqbQg6edWbX6TYbhkpiErBvy9B4KFFcTZQ==',key_name='tempest-keypair-122805512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-lj7201hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1633655156',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61052c8663184644aa445e8b29a9d6ed',uuid=055ad398-aa12-4378-a63a-e2a3562f661e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:a4,bridge_name='br-int',has_traffic_filtering=True,id=8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2ab5b5-1d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'pci_devices' on Instance uuid 055ad398-aa12-4378-a63a-e2a3562f661e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:20:05 user nova-compute[75257]:   <uuid>055ad398-aa12-4378-a63a-e2a3562f661e</uuid>
Nov 14 02:20:05 user nova-compute[75257]:   <name>instance-00000022</name>
Nov 14 02:20:05 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:20:05 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:20:05 user nova-compute[75257]:   <metadata>
Nov 14 02:20:05 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:20:05 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:20:05 user nova-compute[75257]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-655354691</nova:name>
Nov 14 02:20:05 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:20:04</nova:creationTime>
Nov 14 02:20:05 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:20:05 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:20:05 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:20:05 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:20:05 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:20:05 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:20:05 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:20:05 user nova-compute[75257]:       <nova:owner>
Nov 14 02:20:05 user nova-compute[75257]:         <nova:user uuid="61052c8663184644aa445e8b29a9d6ed">tempest-TestVolumeBootPattern-1633655156-project-member</nova:user>
Nov 14 02:20:05 user nova-compute[75257]:         <nova:project uuid="6e49d1cf0a1c457ab943ffd360f1c3da">tempest-TestVolumeBootPattern-1633655156</nova:project>
Nov 14 02:20:05 user nova-compute[75257]:       </nova:owner>
Nov 14 02:20:05 user nova-compute[75257]:       <nova:root type="image" uuid="7ec1582b-bd06-4bd6-ad74-b5cfd1ffd97b"/>
Nov 14 02:20:05 user nova-compute[75257]:       <nova:ports>
Nov 14 02:20:05 user nova-compute[75257]:         <nova:port uuid="8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2">
Nov 14 02:20:05 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 02:20:05 user nova-compute[75257]:         </nova:port>
Nov 14 02:20:05 user nova-compute[75257]:       </nova:ports>
Nov 14 02:20:05 user nova-compute[75257]:     </nova:instance>
Nov 14 02:20:05 user nova-compute[75257]:   </metadata>
Nov 14 02:20:05 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:20:05 user nova-compute[75257]:     <system>
Nov 14 02:20:05 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:20:05 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:20:05 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:20:05 user nova-compute[75257]:       <entry name="serial">055ad398-aa12-4378-a63a-e2a3562f661e</entry>
Nov 14 02:20:05 user nova-compute[75257]:       <entry name="uuid">055ad398-aa12-4378-a63a-e2a3562f661e</entry>
Nov 14 02:20:05 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:20:05 user nova-compute[75257]:     </system>
Nov 14 02:20:05 user nova-compute[75257]:   </sysinfo>
Nov 14 02:20:05 user nova-compute[75257]:   <os>
Nov 14 02:20:05 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:20:05 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:20:05 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:20:05 user nova-compute[75257]:   </os>
Nov 14 02:20:05 user nova-compute[75257]:   <features>
Nov 14 02:20:05 user nova-compute[75257]:     <acpi/>
Nov 14 02:20:05 user nova-compute[75257]:     <apic/>
Nov 14 02:20:05 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:20:05 user nova-compute[75257]:   </features>
Nov 14 02:20:05 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:20:05 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:20:05 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:20:05 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:20:05 user nova-compute[75257]:   </clock>
Nov 14 02:20:05 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:20:05 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:20:05 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:20:05 user nova-compute[75257]:   </cpu>
Nov 14 02:20:05 user nova-compute[75257]:   <devices>
Nov 14 02:20:05 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:20:05 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:20:05 user nova-compute[75257]:       <source dev="/dev/sdb"/>
Nov 14 02:20:05 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:20:05 user nova-compute[75257]:       <serial>fd4a26c6-87c2-4029-b8d5-f9b810606ff5</serial>
Nov 14 02:20:05 user nova-compute[75257]:     </disk>
Nov 14 02:20:05 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:20:05 user nova-compute[75257]:       <mac address="fa:16:3e:78:27:a4"/>
Nov 14 02:20:05 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:20:05 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:20:05 user nova-compute[75257]:       <target dev="tap8e2ab5b5-1d"/>
Nov 14 02:20:05 user nova-compute[75257]:     </interface>
Nov 14 02:20:05 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:20:05 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/055ad398-aa12-4378-a63a-e2a3562f661e/console.log" append="off"/>
Nov 14 02:20:05 user nova-compute[75257]:     </serial>
Nov 14 02:20:05 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:20:05 user nova-compute[75257]:     <video>
Nov 14 02:20:05 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:20:05 user nova-compute[75257]:     </video>
Nov 14 02:20:05 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:20:05 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:20:05 user nova-compute[75257]:     </rng>
Nov 14 02:20:05 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:20:05 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:20:05 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:20:05 user nova-compute[75257]:     </memballoon>
Nov 14 02:20:05 user nova-compute[75257]:   </devices>
Nov 14 02:20:05 user nova-compute[75257]: </domain>
Nov 14 02:20:05 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-655354691',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-655354691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-655354691',id=34,image_ref='7ec1582b-bd06-4bd6-ad74-b5cfd1ffd97b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMfSbaIQjsDXUesX0QJMxpnjVwksnTpxHa42LE+eNaaAX/mAoIPiSgn1p7l9i13oPo6C0FpWOPz7OfXHeP0HYMXBBGYL0SUBqbQg6edWbX6TYbhkpiErBvy9B4KFFcTZQ==',key_name='tempest-keypair-122805512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-lj7201hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1633655156',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61052c8663184644aa445e8b29a9d6ed',uuid=055ad398-aa12-4378-a63a-e2a3562f661e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:a4,bridge_name='br-int',has_traffic_filtering=True,id=8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2ab5b5-1d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG os_vif [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:a4,bridge_name='br-int',has_traffic_filtering=True,id=8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2ab5b5-1d') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9a145a8-00a6-5e13-9c8f-aff6777062b9', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e2ab5b5-1d, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e2ab5b5-1d, col_values=(('qos', UUID('9053429d-54b5-4e29-b8de-efbfd6a63a8b')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e2ab5b5-1d, col_values=(('external_ids', {'iface-id': '8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:27:a4', 'vm-uuid': '055ad398-aa12-4378-a63a-e2a3562f661e'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:05 user nova-compute[75257]: INFO os_vif [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:a4,bridge_name='br-int',has_traffic_filtering=True,id=8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2ab5b5-1d')
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:20:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No VIF found with MAC fa:16:3e:78:27:a4, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received event network-vif-plugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] Acquiring lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] No waiting events found dispatching network-vif-plugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:20:07 user nova-compute[75257]: WARNING nova.compute.manager [req-9330bb05-dc4b-455b-adbd-0d7c9db3bb87 req-304e5397-a95f-4ef5-8c62-a7af147496ee service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received unexpected event network-vif-plugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance with vm_state building and task_state spawning.
Nov 14 02:20:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:07 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:20:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received event network-vif-plugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:20:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] Acquiring lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] No waiting events found dispatching network-vif-plugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:20:09 user nova-compute[75257]: WARNING nova.compute.manager [req-dff31c92-af2a-4687-9f95-f4c1a3dea2f5 req-bf357045-fd2e-4550-91b3-ada896d0598f service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received unexpected event network-vif-plugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance with vm_state building and task_state spawning.
Nov 14 02:20:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:20:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:20:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Instance spawned successfully.
Nov 14 02:20:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:20:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:20:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:20:09 user nova-compute[75257]: INFO nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 14 02:20:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:20:09 user nova-compute[75257]: INFO nova.compute.manager [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Took 17.00 seconds to build instance.
Nov 14 02:20:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0a7a0eea-d3b9-4dc0-9e37-56ae2d6c08e2 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "055ad398-aa12-4378-a63a-e2a3562f661e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.117s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received event network-changed-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:20:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Refreshing instance network info cache due to event network-changed-0fd725b9-7697-4d77-9a86-2fc0b2a80e03. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:20:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] Acquiring lock "refresh_cache-0ef2a690-6f55-4d15-aac7-323e90b3e232" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:20:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] Acquired lock "refresh_cache-0ef2a690-6f55-4d15-aac7-323e90b3e232" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:20:12 user nova-compute[75257]: DEBUG nova.network.neutron [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Refreshing network info cache for port 0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:20:13 user nova-compute[75257]: DEBUG nova.network.neutron [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Updated VIF entry in instance network info cache for port 0fd725b9-7697-4d77-9a86-2fc0b2a80e03. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:20:13 user nova-compute[75257]: DEBUG nova.network.neutron [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Updating instance_info_cache with network_info: [{"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:20:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-abec8ced-54b0-4395-82c2-b4323566e880 req-b3c7df89-c8a4-4782-8422-6e03267b2cc0 service nova] Releasing lock "refresh_cache-0ef2a690-6f55-4d15-aac7-323e90b3e232" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'flavor' on Instance uuid 0ef2a690-6f55-4d15-aac7-323e90b3e232 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:20:14 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Ignoring supplied device name: /dev/vdb
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:14 user nova-compute[75257]: INFO nova.compute.manager [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Attaching volume c9bac177-b16d-4e2e-82ef-12caa90ec908 to /dev/vdb
Nov 14 02:20:14 user nova-compute[75257]: DEBUG os_brick.utils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49a2218-d5c7-4939-802e-6ff5f4f314c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6375752f-7b2c-4acf-9759-6c978dd40e7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d967ed-4f19-4779-b4ca-17537cff55be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[098bcf44-35b1-4e02-be06-25590252448a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:20:14 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:20:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0805d2c2-b464-4272-a93c-81a5f0d6bed9]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG os_brick.utils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:20:14 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Updating existing volume attachment record: 93a6407f-94a0-4278-a19d-c17e24a93ac6 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:20:15 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:20:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IELsXoav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:20:18 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:20:18 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:20:18 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee23bb43-8872-425d-807f-93e71a26ad76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:20:18 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[965faff0-26cb-4e25-a849-ae50e934d4d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908] added
Nov 14 02:20:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e0ab0f-1287-47d5-a7ee-788237b5426b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e687315-328d-454a-839f-9963e75f1bad]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IELsXoav {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IELsXoav" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd58f9c-f9dc-4e0b-b5a8-de28337cd380]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IELsXoav'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62066e9-123b-4ea1-99dd-3961d53558ae]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5ea2e1-ad66-4b31-8a3c-22955301ddf9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:18 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8ab401-1e72-45dd-ba1a-75595dfede62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908, portal: 172.16.0.220,3260]
Nov 14 02:20:18 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908, portal: 172.16.0.220,3260] successful.
Nov 14 02:20:18 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca986b-933c-44bf-bdcb-e5db6276c3dd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b715bc0-1d8b-4914-b7a0-3d3089bf8896]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 (non-flash)
Nov 14 02:20:19 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] HCTL ('39', '-', '-', 0) found on session 44 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df67e69-3c76-4cc4-9abd-25f1fc0d2904]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Searching for a device in session 44 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:20:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IELsXoav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23334333437616332', 'path': '/dev/sdh'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334333437616332', 'path': '/dev/sdh'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'flavor' on Instance uuid 0ef2a690-6f55-4d15-aac7-323e90b3e232 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:20:20 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:20:20 user nova-compute[75257]:   <source dev="/dev/sdh"/>
Nov 14 02:20:20 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:20:20 user nova-compute[75257]:   <serial>c9bac177-b16d-4e2e-82ef-12caa90ec908</serial>
Nov 14 02:20:20 user nova-compute[75257]: </disk>
Nov 14 02:20:20 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No VIF found with MAC fa:16:3e:38:91:13, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6cc3f41d-5b40-4a77-aa77-ee3f9cd53b3e tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.579s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:29 user nova-compute[75257]: INFO nova.compute.manager [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Detaching volume c9bac177-b16d-4e2e-82ef-12caa90ec908
Nov 14 02:20:29 user nova-compute[75257]: INFO nova.virt.block_device [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Attempting to driver detach volume c9bac177-b16d-4e2e-82ef-12caa90ec908 from mountpoint /dev/vdb
Nov 14 02:20:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Attempting to detach device vdb from instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:20:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:20:29 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:20:29 user nova-compute[75257]:   <source dev="/dev/sdh"/>
Nov 14 02:20:29 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:20:29 user nova-compute[75257]:   <serial>c9bac177-b16d-4e2e-82ef-12caa90ec908</serial>
Nov 14 02:20:29 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:20:29 user nova-compute[75257]: </disk>
Nov 14 02:20:29 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:20:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Successfully detached device vdb from instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 from the persistent domain config.
Nov 14 02:20:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:20:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:20:29 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:20:29 user nova-compute[75257]:   <source dev="/dev/sdh"/>
Nov 14 02:20:29 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:20:29 user nova-compute[75257]:   <serial>c9bac177-b16d-4e2e-82ef-12caa90ec908</serial>
Nov 14 02:20:29 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:20:29 user nova-compute[75257]: </disk>
Nov 14 02:20:29 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:20:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:20:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:43 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:20:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:20:43 user nova-compute[75257]: INFO nova.compute.claims [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Claim successful on node user
Nov 14 02:20:44 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:20:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:20:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG nova.policy [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:20:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Creating image(s)
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "/opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "/opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk 1073741824" returned: 0 in 0.053s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Successfully created port: b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Cannot resize image /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Ensure instance console log exists: /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Successfully updated port: b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "refresh_cache-6bc79fc1-8d23-443f-99b5-2464e115a1be" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquired lock "refresh_cache-6bc79fc1-8d23-443f-99b5-2464e115a1be" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-changed-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Refreshing instance network info cache due to event network-changed-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] Acquiring lock "refresh_cache-6bc79fc1-8d23-443f-99b5-2464e115a1be" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Updating instance_info_cache with network_info: [{"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Releasing lock "refresh_cache-6bc79fc1-8d23-443f-99b5-2464e115a1be" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Instance network_info: |[{"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] Acquired lock "refresh_cache-6bc79fc1-8d23-443f-99b5-2464e115a1be" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.network.neutron [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Refreshing network info cache for port b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Start _get_guest_xml network_info=[{"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:20:45 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:20:45 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:20:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2044879744',display_name='tempest-AttachVolumeNegativeTest-server-2044879744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2044879744',id=35,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl7faLyiziutpEyCrhRIdksI+U7pL8LoCdnPmNKFmtcaBmmF4UR1dwk+RU5o1eV6Prup3hKzl11gsZDIVF4WFNlc2j1N2f8xeBCstMWK3/dQVxhOBCuif1TlpGUbmr9Og==',key_name='tempest-keypair-438637596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-w3d0jouf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=6bc79fc1-8d23-443f-99b5-2464e115a1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:53:b7,bridge_name='br-int',has_traffic_filtering=True,id=b08dac99-5ce4-4efa-bf90-82b90a1ca4c7,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08dac99-5c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bc79fc1-8d23-443f-99b5-2464e115a1be {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:20:46 user nova-compute[75257]:   <uuid>6bc79fc1-8d23-443f-99b5-2464e115a1be</uuid>
Nov 14 02:20:46 user nova-compute[75257]:   <name>instance-00000023</name>
Nov 14 02:20:46 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:20:46 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:20:46 user nova-compute[75257]:   <metadata>
Nov 14 02:20:46 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:20:46 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:20:46 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2044879744</nova:name>
Nov 14 02:20:46 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:20:45</nova:creationTime>
Nov 14 02:20:46 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:20:46 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:20:46 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:20:46 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:20:46 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:20:46 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:20:46 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:20:46 user nova-compute[75257]:       <nova:owner>
Nov 14 02:20:46 user nova-compute[75257]:         <nova:user uuid="ca8f18684c914e9f93d16df39763743e">tempest-AttachVolumeNegativeTest-1714659318-project-member</nova:user>
Nov 14 02:20:46 user nova-compute[75257]:         <nova:project uuid="bb0268a9065e45f5978c20365956e369">tempest-AttachVolumeNegativeTest-1714659318</nova:project>
Nov 14 02:20:46 user nova-compute[75257]:       </nova:owner>
Nov 14 02:20:46 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:20:46 user nova-compute[75257]:       <nova:ports>
Nov 14 02:20:46 user nova-compute[75257]:         <nova:port uuid="b08dac99-5ce4-4efa-bf90-82b90a1ca4c7">
Nov 14 02:20:46 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 02:20:46 user nova-compute[75257]:         </nova:port>
Nov 14 02:20:46 user nova-compute[75257]:       </nova:ports>
Nov 14 02:20:46 user nova-compute[75257]:     </nova:instance>
Nov 14 02:20:46 user nova-compute[75257]:   </metadata>
Nov 14 02:20:46 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:20:46 user nova-compute[75257]:     <system>
Nov 14 02:20:46 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:20:46 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:20:46 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:20:46 user nova-compute[75257]:       <entry name="serial">6bc79fc1-8d23-443f-99b5-2464e115a1be</entry>
Nov 14 02:20:46 user nova-compute[75257]:       <entry name="uuid">6bc79fc1-8d23-443f-99b5-2464e115a1be</entry>
Nov 14 02:20:46 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:20:46 user nova-compute[75257]:     </system>
Nov 14 02:20:46 user nova-compute[75257]:   </sysinfo>
Nov 14 02:20:46 user nova-compute[75257]:   <os>
Nov 14 02:20:46 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:20:46 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:20:46 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:20:46 user nova-compute[75257]:   </os>
Nov 14 02:20:46 user nova-compute[75257]:   <features>
Nov 14 02:20:46 user nova-compute[75257]:     <acpi/>
Nov 14 02:20:46 user nova-compute[75257]:     <apic/>
Nov 14 02:20:46 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:20:46 user nova-compute[75257]:   </features>
Nov 14 02:20:46 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:20:46 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:20:46 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:20:46 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:20:46 user nova-compute[75257]:   </clock>
Nov 14 02:20:46 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:20:46 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:20:46 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:20:46 user nova-compute[75257]:   </cpu>
Nov 14 02:20:46 user nova-compute[75257]:   <devices>
Nov 14 02:20:46 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:20:46 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:20:46 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk"/>
Nov 14 02:20:46 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:20:46 user nova-compute[75257]:     </disk>
Nov 14 02:20:46 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:20:46 user nova-compute[75257]:       <mac address="fa:16:3e:cd:53:b7"/>
Nov 14 02:20:46 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:20:46 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:20:46 user nova-compute[75257]:       <target dev="tapb08dac99-5c"/>
Nov 14 02:20:46 user nova-compute[75257]:     </interface>
Nov 14 02:20:46 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:20:46 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/console.log" append="off"/>
Nov 14 02:20:46 user nova-compute[75257]:     </serial>
Nov 14 02:20:46 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:20:46 user nova-compute[75257]:     <video>
Nov 14 02:20:46 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:20:46 user nova-compute[75257]:     </video>
Nov 14 02:20:46 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:20:46 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:20:46 user nova-compute[75257]:     </rng>
Nov 14 02:20:46 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:20:46 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:20:46 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:20:46 user nova-compute[75257]:     </memballoon>
Nov 14 02:20:46 user nova-compute[75257]:   </devices>
Nov 14 02:20:46 user nova-compute[75257]: </domain>
Nov 14 02:20:46 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2044879744',display_name='tempest-AttachVolumeNegativeTest-server-2044879744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2044879744',id=35,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl7faLyiziutpEyCrhRIdksI+U7pL8LoCdnPmNKFmtcaBmmF4UR1dwk+RU5o1eV6Prup3hKzl11gsZDIVF4WFNlc2j1N2f8xeBCstMWK3/dQVxhOBCuif1TlpGUbmr9Og==',key_name='tempest-keypair-438637596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-w3d0jouf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:20:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=6bc79fc1-8d23-443f-99b5-2464e115a1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:53:b7,bridge_name='br-int',has_traffic_filtering=True,id=b08dac99-5ce4-4efa-bf90-82b90a1ca4c7,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08dac99-5c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG os_vif [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:53:b7,bridge_name='br-int',has_traffic_filtering=True,id=b08dac99-5ce4-4efa-bf90-82b90a1ca4c7,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08dac99-5c') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb3b38a5-a756-5ac9-8a62-83daed9b8a1b', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb08dac99-5c, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb08dac99-5c, col_values=(('qos', UUID('058c743b-1588-471c-a21a-e1138e964adb')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb08dac99-5c, col_values=(('external_ids', {'iface-id': 'b08dac99-5ce4-4efa-bf90-82b90a1ca4c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:53:b7', 'vm-uuid': '6bc79fc1-8d23-443f-99b5-2464e115a1be'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:46 user nova-compute[75257]: INFO os_vif [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:53:b7,bridge_name='br-int',has_traffic_filtering=True,id=b08dac99-5ce4-4efa-bf90-82b90a1ca4c7,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08dac99-5c')
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No VIF found with MAC fa:16:3e:cd:53:b7, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.network.neutron [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Updated VIF entry in instance network info cache for port b08dac99-5ce4-4efa-bf90-82b90a1ca4c7. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG nova.network.neutron [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Updating instance_info_cache with network_info: [{"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:20:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-41300e0b-99c3-4b79-ac53-e4279e13a4d4 req-dede3823-2327-4028-8b4d-771d4ae00f66 service nova] Releasing lock "refresh_cache-6bc79fc1-8d23-443f-99b5-2464e115a1be" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:20:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:20:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] No waiting events found dispatching network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:20:47 user nova-compute[75257]: WARNING nova.compute.manager [req-8e2af641-19f7-418a-b404-72dae693073b req-66b22b54-5f64-4958-98a7-d9a73288e058 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received unexpected event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance with vm_state building and task_state spawning.
Nov 14 02:20:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:20:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Instance spawned successfully.
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:20:49 user nova-compute[75257]: INFO nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] No waiting events found dispatching network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:20:49 user nova-compute[75257]: WARNING nova.compute.manager [req-bba096ea-c3a5-4ad1-a996-bbfda2da5c9d req-e4917a67-5993-4b03-a138-a66cb38684e1 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received unexpected event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance with vm_state building and task_state spawning.
Nov 14 02:20:49 user nova-compute[75257]: INFO nova.compute.manager [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Took 5.91 seconds to build instance.
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ebcf05b0-1365-4fbe-a5d0-116d7a5f0ea1 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:49 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 is timed out.
Nov 14 02:20:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Successfully detached device vdb from instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 from the live domain config.
Nov 14 02:20:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IELsXoav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:20:49 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5194f8b8-0ead-4f07-aca4-24b52c74c8a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:20:49 user nova-compute[75257]: No targets found.
Nov 14 02:20:49 user nova-compute[75257]: iSNS:
Nov 14 02:20:49 user nova-compute[75257]: No targets found.
Nov 14 02:20:49 user nova-compute[75257]: STATIC:
Nov 14 02:20:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:20:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908
Nov 14 02:20:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112
Nov 14 02:20:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:20:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5
Nov 14 02:20:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:20:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:49 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb
Nov 14 02:20:49 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:49 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:49 user nova-compute[75257]: FIRMWARE:
Nov 14 02:20:49 user nova-compute[75257]: No targets found.
Nov 14 02:20:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:20:49 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:20:49 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1281fb09-b2d3-4843-82e4-9610a596c4c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7012841-ca63-4476-9ada-8842c548b2b1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 (non-flash)
Nov 14 02:20:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c11a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908'): ({'sdh'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Removing single pathed devices sdh {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:20:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[382a0a7e-79e3-497a-b113-09803b9c21a0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4862aa2d-ca6e-4f21-8847-bf03e75d2a24]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flushing IO for device /dev/sdh {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[904373d5-00e7-4ba0-8b75-0ed4ae41cc29]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1b8601-b3fd-4b00-a2aa-04d2779da3e7]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] SCSI volumes sdh have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a13e68-37ba-41eb-893d-961bdbb0a674]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6331687-f3eb-4d5e-8be3-50c4a55b9ad6]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908, portal: 172.16.0.220,3260]
Nov 14 02:20:50 user nova-compute[75257]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908, portal: 172.16.0.220,3260] successful.
Nov 14 02:20:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eb1fe8-a07b-4739-84c8-d44a635274a9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] <== disconnect_volume: return (376ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:20:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'flavor' on Instance uuid 0ef2a690-6f55-4d15-aac7-323e90b3e232 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b3e1e509-e23f-43c5-9622-4bb8948f4f83 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.639s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:51 user nova-compute[75257]: INFO nova.compute.manager [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Terminating instance
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received event network-vif-unplugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] No waiting events found dispatching network-vif-unplugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-312a53a2-3986-4d7a-a319-37b4cf8b35e0 req-df0ec8b6-a1b4-48c1-b104-893013c513b8 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received event network-vif-unplugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:20:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Instance destroyed successfully.
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.objects.instance [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'resources' on Instance uuid 0ef2a690-6f55-4d15-aac7-323e90b3e232 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:18:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-438855487',display_name='tempest-VolumesSnapshotTestJSON-instance-438855487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-438855487',id=32,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNTz2d3GJuvS5CW6sTnUaAmT+KYp2EJmlGkb0wNZl+WWgtkFVUgYoM6HJEmYEFDMRwaBXEI+jsS3sdRXNVmHwb4u+menTy6hdNQs4uiJ1UBAoQVLynDNCjoRx4vv/+Ilg==',key_name='tempest-keypair-1744969399',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:18:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdd36fad5dd04e79a672f69b7e100ae5',ramdisk_id='',reservation_id='r-k4rynj0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-408710193',owner_user_name='tempest-VolumesSnapshotTestJSON-408710193-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0729cfec73f44f4eafb49d51f9ce01e2',uuid=0ef2a690-6f55-4d15-aac7-323e90b3e232,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converting VIF {"id": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "address": "fa:16:3e:38:91:13", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd725b9-76", "ovs_interfaceid": "0fd725b9-7697-4d77-9a86-2fc0b2a80e03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:91:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd725b9-7697-4d77-9a86-2fc0b2a80e03,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd725b9-76') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG os_vif [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:91:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd725b9-7697-4d77-9a86-2fc0b2a80e03,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd725b9-76') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fd725b9-76, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e68f5a2-03fe-4e40-a984-663ddbecd8ac) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:51 user nova-compute[75257]: INFO os_vif [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:91:13,bridge_name='br-int',has_traffic_filtering=True,id=0fd725b9-7697-4d77-9a86-2fc0b2a80e03,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd725b9-76')
Nov 14 02:20:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IELsXoav', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:20:51 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:20:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8ef0f8-afdc-4b6a-8f4e-d210d7d2c0c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:20:51 user nova-compute[75257]: No targets found.
Nov 14 02:20:51 user nova-compute[75257]: iSNS:
Nov 14 02:20:51 user nova-compute[75257]: No targets found.
Nov 14 02:20:51 user nova-compute[75257]: STATIC:
Nov 14 02:20:51 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:20:51 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:51 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:51 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112
Nov 14 02:20:51 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:51 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:51 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:20:51 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:51 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:51 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5
Nov 14 02:20:51 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:51 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:51 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:20:51 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:51 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:51 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb
Nov 14 02:20:51 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:20:51 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:20:51 user nova-compute[75257]: FIRMWARE:
Nov 14 02:20:51 user nova-compute[75257]: No targets found.
Nov 14 02:20:51 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:20:51 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:20:51 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9bac177-b16d-4e2e-82ef-12caa90ec908', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1c7f51-76bb-4d14-b52a-bfabc722add6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27e0fb5-1db1-439d-84f9-7101cbd60019]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:52 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:20:52 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:20:52 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c429000>, {}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Disconnecting from: [] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] <== disconnect_volume: return (89ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:20:52 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Deleting instance files /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232_del
Nov 14 02:20:52 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Deletion of /opt/stack/data/nova/instances/0ef2a690-6f55-4d15-aac7-323e90b3e232_del complete
Nov 14 02:20:52 user nova-compute[75257]: INFO nova.compute.manager [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 14 02:20:52 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received event network-vif-deleted-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:20:52 user nova-compute[75257]: INFO nova.compute.manager [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Neutron deleted interface 0fd725b9-7697-4d77-9a86-2fc0b2a80e03; detaching it from the instance and deleting it from the info cache
Nov 14 02:20:52 user nova-compute[75257]: DEBUG nova.network.neutron [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:20:52 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Took 0.76 seconds to deallocate network for instance.
Nov 14 02:20:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-0b0fb24d-c211-458d-8f4e-5f5a0dce6ba1 req-c991f791-5d63-45ea-a0a5-38df38242236 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Detach interface failed, port_id=0fd725b9-7697-4d77-9a86-2fc0b2a80e03, reason: Instance 0ef2a690-6f55-4d15-aac7-323e90b3e232 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:20:52 user nova-compute[75257]: WARNING nova.volume.cinder [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Attachment 93a6407f-94a0-4278-a19d-c17e24a93ac6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 93a6407f-94a0-4278-a19d-c17e24a93ac6. (HTTP 404) (Request-ID: req-08059ba0-11a5-4d1e-9bb2-6960c54aba1f)
Nov 14 02:20:52 user nova-compute[75257]: INFO nova.compute.manager [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 02:20:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received event network-vif-plugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:20:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] Acquiring lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] No waiting events found dispatching network-vif-plugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:20:53 user nova-compute[75257]: WARNING nova.compute.manager [req-d83c220d-f574-48cb-a693-caad3aa2a6b6 req-76cc14e0-3389-455b-a390-b5950674e2e6 service nova] [instance: 0ef2a690-6f55-4d15-aac7-323e90b3e232] Received unexpected event network-vif-plugged-0fd725b9-7697-4d77-9a86-2fc0b2a80e03 for instance with vm_state deleted and task_state None.
Nov 14 02:20:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:20:53 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:20:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.628s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:53 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Deleted allocations for instance 0ef2a690-6f55-4d15-aac7-323e90b3e232
Nov 14 02:20:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-86e94450-4b57-45e3-8430-7d10459d40c0 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "0ef2a690-6f55-4d15-aac7-323e90b3e232" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.787s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:20:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:20:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:20:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:20:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:57 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:20:57 user nova-compute[75257]: INFO nova.compute.claims [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Claim successful on node user
Nov 14 02:20:58 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:20:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:20:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:20:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Creating image(s)
Nov 14 02:20:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG nova.policy [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5f8a4942cb54c9aa5377e6d2df1aa7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ac9795cbe748fc8079de4bb8234cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.197s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk 1073741824" returned: 0 in 0.057s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Successfully created port: cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Cannot resize image /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Ensure instance console log exists: /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:20:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Successfully updated port: cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquired lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-changed-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Refreshing instance network info cache due to event network-changed-cbd77511-3da8-4b8f-bd1c-bb5e9992f811. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] Acquiring lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updating instance_info_cache with network_info: [{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Releasing lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Instance network_info: |[{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] Acquired lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Refreshing network info cache for port cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Start _get_guest_xml network_info=[{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:21:00 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:21:00 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-174000204',display_name='tempest-ServerRescueNegativeTestJSON-server-174000204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-174000204',id=36,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsFmFIPhOCkXP+VUy2d+niU2Ks7ncJCtipI380Z6fBMTn/cwQN6BjKiVmK+YzwFjPQUOcxjnbmNi7hQtgs8AMfiaBh5aypsW4p/ucVfVfpy5S1RpOX+1GnlAPNw74qPJQ==',key_name='tempest-keypair-34722916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-taocfvzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=14f49370-77df-4e76-8e1d-4f89580315a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=cbd77511-3da8-4b8f-bd1c-bb5e9992f811,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd77511-3d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'pci_devices' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:21:00 user nova-compute[75257]:   <uuid>14f49370-77df-4e76-8e1d-4f89580315a4</uuid>
Nov 14 02:21:00 user nova-compute[75257]:   <name>instance-00000024</name>
Nov 14 02:21:00 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:21:00 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:21:00 user nova-compute[75257]:   <metadata>
Nov 14 02:21:00 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:21:00 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:21:00 user nova-compute[75257]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-174000204</nova:name>
Nov 14 02:21:00 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:21:00</nova:creationTime>
Nov 14 02:21:00 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:21:00 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:21:00 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:21:00 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:21:00 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:21:00 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:21:00 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:21:00 user nova-compute[75257]:       <nova:owner>
Nov 14 02:21:00 user nova-compute[75257]:         <nova:user uuid="a5f8a4942cb54c9aa5377e6d2df1aa7b">tempest-ServerRescueNegativeTestJSON-66746497-project-member</nova:user>
Nov 14 02:21:00 user nova-compute[75257]:         <nova:project uuid="68ac9795cbe748fc8079de4bb8234cd3">tempest-ServerRescueNegativeTestJSON-66746497</nova:project>
Nov 14 02:21:00 user nova-compute[75257]:       </nova:owner>
Nov 14 02:21:00 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:21:00 user nova-compute[75257]:       <nova:ports>
Nov 14 02:21:00 user nova-compute[75257]:         <nova:port uuid="cbd77511-3da8-4b8f-bd1c-bb5e9992f811">
Nov 14 02:21:00 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 02:21:00 user nova-compute[75257]:         </nova:port>
Nov 14 02:21:00 user nova-compute[75257]:       </nova:ports>
Nov 14 02:21:00 user nova-compute[75257]:     </nova:instance>
Nov 14 02:21:00 user nova-compute[75257]:   </metadata>
Nov 14 02:21:00 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:21:00 user nova-compute[75257]:     <system>
Nov 14 02:21:00 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:21:00 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:21:00 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:21:00 user nova-compute[75257]:       <entry name="serial">14f49370-77df-4e76-8e1d-4f89580315a4</entry>
Nov 14 02:21:00 user nova-compute[75257]:       <entry name="uuid">14f49370-77df-4e76-8e1d-4f89580315a4</entry>
Nov 14 02:21:00 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:21:00 user nova-compute[75257]:     </system>
Nov 14 02:21:00 user nova-compute[75257]:   </sysinfo>
Nov 14 02:21:00 user nova-compute[75257]:   <os>
Nov 14 02:21:00 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:21:00 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:21:00 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:21:00 user nova-compute[75257]:   </os>
Nov 14 02:21:00 user nova-compute[75257]:   <features>
Nov 14 02:21:00 user nova-compute[75257]:     <acpi/>
Nov 14 02:21:00 user nova-compute[75257]:     <apic/>
Nov 14 02:21:00 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:21:00 user nova-compute[75257]:   </features>
Nov 14 02:21:00 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:21:00 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:21:00 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:21:00 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:21:00 user nova-compute[75257]:   </clock>
Nov 14 02:21:00 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:21:00 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:21:00 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:21:00 user nova-compute[75257]:   </cpu>
Nov 14 02:21:00 user nova-compute[75257]:   <devices>
Nov 14 02:21:00 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:21:00 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:21:00 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk"/>
Nov 14 02:21:00 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:21:00 user nova-compute[75257]:     </disk>
Nov 14 02:21:00 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:21:00 user nova-compute[75257]:       <mac address="fa:16:3e:14:b4:b9"/>
Nov 14 02:21:00 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:21:00 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:21:00 user nova-compute[75257]:       <target dev="tapcbd77511-3d"/>
Nov 14 02:21:00 user nova-compute[75257]:     </interface>
Nov 14 02:21:00 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:21:00 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/console.log" append="off"/>
Nov 14 02:21:00 user nova-compute[75257]:     </serial>
Nov 14 02:21:00 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:21:00 user nova-compute[75257]:     <video>
Nov 14 02:21:00 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:21:00 user nova-compute[75257]:     </video>
Nov 14 02:21:00 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:21:00 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:21:00 user nova-compute[75257]:     </rng>
Nov 14 02:21:00 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:21:00 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:21:00 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:21:00 user nova-compute[75257]:     </memballoon>
Nov 14 02:21:00 user nova-compute[75257]:   </devices>
Nov 14 02:21:00 user nova-compute[75257]: </domain>
Nov 14 02:21:00 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-174000204',display_name='tempest-ServerRescueNegativeTestJSON-server-174000204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-174000204',id=36,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsFmFIPhOCkXP+VUy2d+niU2Ks7ncJCtipI380Z6fBMTn/cwQN6BjKiVmK+YzwFjPQUOcxjnbmNi7hQtgs8AMfiaBh5aypsW4p/ucVfVfpy5S1RpOX+1GnlAPNw74qPJQ==',key_name='tempest-keypair-34722916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-taocfvzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=14f49370-77df-4e76-8e1d-4f89580315a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=cbd77511-3da8-4b8f-bd1c-bb5e9992f811,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd77511-3d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG os_vif [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=cbd77511-3da8-4b8f-bd1c-bb5e9992f811,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd77511-3d') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a711a42e-a976-5cb5-8df0-c6b497b2972f', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbd77511-3d, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbd77511-3d, col_values=(('qos', UUID('74c3bffb-4fc0-43de-8b78-c2f4c735a9ac')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbd77511-3d, col_values=(('external_ids', {'iface-id': 'cbd77511-3da8-4b8f-bd1c-bb5e9992f811', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:b4:b9', 'vm-uuid': '14f49370-77df-4e76-8e1d-4f89580315a4'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:00 user nova-compute[75257]: INFO os_vif [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=cbd77511-3da8-4b8f-bd1c-bb5e9992f811,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd77511-3d')
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No VIF found with MAC fa:16:3e:14:b4:b9, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updated VIF entry in instance network info cache for port cbd77511-3da8-4b8f-bd1c-bb5e9992f811. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updating instance_info_cache with network_info: [{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5979f322-0d62-4a04-9bcb-154cd866241e req-e44c4bfd-067b-4c7f-8928-83c18c4919f3 service nova] Releasing lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:21:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:21:02 user nova-compute[75257]: WARNING nova.compute.manager [req-fd1e01e8-d5b3-45fd-bd1e-c5d70b30aaca req-236ab109-2b7d-453b-973f-7b29a5cf2098 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state building and task_state spawning.
Nov 14 02:21:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:21:04 user nova-compute[75257]: WARNING nova.compute.manager [req-0e1e54be-4e86-4baa-bc8f-57904c5a96ed req-5054f445-ae0d-4163-82c3-17644681b4b4 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state building and task_state spawning.
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:21:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Instance spawned successfully.
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:04 user nova-compute[75257]: INFO nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:04 user nova-compute[75257]: INFO nova.compute.manager [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Took 6.64 seconds to build instance.
Nov 14 02:21:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c4e0d20-9af6-49b3-aed3-484a4788a18e tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.746s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:21:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Going to confirm migration 2 {{(pid=75257) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquired lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG nova.network.neutron [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG nova.objects.instance [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'info_cache' on Instance uuid 90d8b16a-a1f1-4625-a715-e5e8bd87d66b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating instance_info_cache with network_info: [{"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Releasing lock "refresh_cache-90d8b16a-a1f1-4625-a715-e5e8bd87d66b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'migration_context' on Instance uuid 90d8b16a-a1f1-4625-a715-e5e8bd87d66b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG nova.objects.base [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Object Instance<90d8b16a-a1f1-4625-a715-e5e8bd87d66b> lazy-loaded attributes: info_cache,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.739s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:08 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Deleted allocation for migration f32320a7-249a-4d70-b8f5-d6a88922f6a2
Nov 14 02:21:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:21:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:21:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:21:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c8a74f69-cafd-48e6-816f-42d195352302 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.887s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:09 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:21:09 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7181MB free_disk=25.081626892089844GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ce3a9680-3062-4e7d-8af3-81c31f3f499c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 9e083a62-27d0-4633-a608-7eb34ddafe2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 987991d7-8a45-49ee-a516-fac07e1d8589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 055ad398-aa12-4378-a63a-e2a3562f661e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 14f49370-77df-4e76-8e1d-4f89580315a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:21:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:21:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:21:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:21:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:21:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updating instance_info_cache with network_info: [{"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:21:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:21:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing instance network info cache due to event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:21:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] Acquiring lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:21:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] Acquired lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:21:19 user nova-compute[75257]: DEBUG nova.network.neutron [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:21:20 user nova-compute[75257]: DEBUG nova.network.neutron [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updated VIF entry in instance network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:21:20 user nova-compute[75257]: DEBUG nova.network.neutron [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updating instance_info_cache with network_info: [{"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a4cb49c5-b08c-4286-b0a8-3f62b8406537 req-dd669464-aefb-4ff8-9aca-a074043e3dd5 service nova] Releasing lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:21:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:20 user nova-compute[75257]: INFO nova.compute.manager [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Detaching volume 006829f8-9e9b-4d9a-a76a-ed873c5b57fb
Nov 14 02:21:20 user nova-compute[75257]: INFO nova.virt.block_device [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Attempting to driver detach volume 006829f8-9e9b-4d9a-a76a-ed873c5b57fb from mountpoint /dev/vdb
Nov 14 02:21:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Attempting to detach device vdb from instance 9e083a62-27d0-4633-a608-7eb34ddafe2c from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:21:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:21:20 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:21:20 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:21:20 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:21:20 user nova-compute[75257]:   <serial>006829f8-9e9b-4d9a-a76a-ed873c5b57fb</serial>
Nov 14 02:21:20 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:21:20 user nova-compute[75257]: </disk>
Nov 14 02:21:20 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:21:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully detached device vdb from instance 9e083a62-27d0-4633-a608-7eb34ddafe2c from the persistent domain config.
Nov 14 02:21:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e083a62-27d0-4633-a608-7eb34ddafe2c from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:21:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:21:20 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:21:20 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:21:20 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:21:20 user nova-compute[75257]:   <serial>006829f8-9e9b-4d9a-a76a-ed873c5b57fb</serial>
Nov 14 02:21:20 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:21:20 user nova-compute[75257]: </disk>
Nov 14 02:21:20 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:21:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:21:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing instance network info cache due to event network-changed-fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:21:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] Acquiring lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:21:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] Acquired lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:21:21 user nova-compute[75257]: DEBUG nova.network.neutron [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Refreshing network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:21:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updated VIF entry in instance network info cache for port fb569262-fb03-4fa0-9d3d-80ab79690476. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:21:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updating instance_info_cache with network_info: [{"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bee980fe-bcef-407f-b71a-bb9cb5b23628 req-c690acec-6ce5-4bd6-be41-f2e5f219a752 service nova] Releasing lock "refresh_cache-9e083a62-27d0-4633-a608-7eb34ddafe2c" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:21:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:21:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:29 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:21:29 user nova-compute[75257]: INFO nova.compute.claims [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Claim successful on node user
Nov 14 02:21:29 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:21:29 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:21:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG nova.network.neutron [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:21:30 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:21:30 user nova-compute[75257]: DEBUG nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG nova.policy [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0729cfec73f44f4eafb49d51f9ce01e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd36fad5dd04e79a672f69b7e100ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:21:30 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Creating image(s)
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "/opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "/opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "/opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk 1073741824" returned: 0 in 0.055s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG nova.network.neutron [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Successfully created port: a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:30 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Cannot resize image /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Ensure instance console log exists: /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Successfully updated port: a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "refresh_cache-59e9702c-fd13-497e-abb9-bf85703fccea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquired lock "refresh_cache-59e9702c-fd13-497e-abb9-bf85703fccea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received event network-changed-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Refreshing instance network info cache due to event network-changed-a346a6b6-4287-489f-a426-f26a927d153c. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] Acquiring lock "refresh_cache-59e9702c-fd13-497e-abb9-bf85703fccea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Updating instance_info_cache with network_info: [{"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Releasing lock "refresh_cache-59e9702c-fd13-497e-abb9-bf85703fccea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Instance network_info: |[{"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] Acquired lock "refresh_cache-59e9702c-fd13-497e-abb9-bf85703fccea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.network.neutron [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Refreshing network info cache for port a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Start _get_guest_xml network_info=[{"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:21:31 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:21:31 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1137021199',display_name='tempest-VolumesSnapshotTestJSON-instance-1137021199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1137021199',id=37,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4yKgyDK23ewe450iUs1rZwM21NYHFAcoK312eJ7UUkzY/DPknEhw1XJrr03KJO7BTArPrFwXojLXC/Yubfbl/x+1OBc0kBiaNaT0KVcBwhR2dL31ZDEOK1fyYWhqY5ww==',key_name='tempest-keypair-817367158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdd36fad5dd04e79a672f69b7e100ae5',ramdisk_id='',reservation_id='r-lmrz0403',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-408710193',owner_user_name='tempest-VolumesSnapshotTestJSON-408710193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0729cfec73f44f4eafb49d51f9ce01e2',uuid=59e9702c-fd13-497e-abb9-bf85703fccea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converting VIF {"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=a346a6b6-4287-489f-a426-f26a927d153c,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa346a6b6-42') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.objects.instance [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'pci_devices' on Instance uuid 59e9702c-fd13-497e-abb9-bf85703fccea {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:21:31 user nova-compute[75257]:   <uuid>59e9702c-fd13-497e-abb9-bf85703fccea</uuid>
Nov 14 02:21:31 user nova-compute[75257]:   <name>instance-00000025</name>
Nov 14 02:21:31 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:21:31 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:21:31 user nova-compute[75257]:   <metadata>
Nov 14 02:21:31 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:21:31 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:21:31 user nova-compute[75257]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1137021199</nova:name>
Nov 14 02:21:31 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:21:31</nova:creationTime>
Nov 14 02:21:31 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:21:31 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:21:31 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:21:31 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:21:31 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:21:31 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:21:31 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:21:31 user nova-compute[75257]:       <nova:owner>
Nov 14 02:21:31 user nova-compute[75257]:         <nova:user uuid="0729cfec73f44f4eafb49d51f9ce01e2">tempest-VolumesSnapshotTestJSON-408710193-project-member</nova:user>
Nov 14 02:21:31 user nova-compute[75257]:         <nova:project uuid="fdd36fad5dd04e79a672f69b7e100ae5">tempest-VolumesSnapshotTestJSON-408710193</nova:project>
Nov 14 02:21:31 user nova-compute[75257]:       </nova:owner>
Nov 14 02:21:31 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:21:31 user nova-compute[75257]:       <nova:ports>
Nov 14 02:21:31 user nova-compute[75257]:         <nova:port uuid="a346a6b6-4287-489f-a426-f26a927d153c">
Nov 14 02:21:31 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 02:21:31 user nova-compute[75257]:         </nova:port>
Nov 14 02:21:31 user nova-compute[75257]:       </nova:ports>
Nov 14 02:21:31 user nova-compute[75257]:     </nova:instance>
Nov 14 02:21:31 user nova-compute[75257]:   </metadata>
Nov 14 02:21:31 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:21:31 user nova-compute[75257]:     <system>
Nov 14 02:21:31 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:21:31 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:21:31 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:21:31 user nova-compute[75257]:       <entry name="serial">59e9702c-fd13-497e-abb9-bf85703fccea</entry>
Nov 14 02:21:31 user nova-compute[75257]:       <entry name="uuid">59e9702c-fd13-497e-abb9-bf85703fccea</entry>
Nov 14 02:21:31 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:21:31 user nova-compute[75257]:     </system>
Nov 14 02:21:31 user nova-compute[75257]:   </sysinfo>
Nov 14 02:21:31 user nova-compute[75257]:   <os>
Nov 14 02:21:31 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:21:31 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:21:31 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:21:31 user nova-compute[75257]:   </os>
Nov 14 02:21:31 user nova-compute[75257]:   <features>
Nov 14 02:21:31 user nova-compute[75257]:     <acpi/>
Nov 14 02:21:31 user nova-compute[75257]:     <apic/>
Nov 14 02:21:31 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:21:31 user nova-compute[75257]:   </features>
Nov 14 02:21:31 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:21:31 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:21:31 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:21:31 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:21:31 user nova-compute[75257]:   </clock>
Nov 14 02:21:31 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:21:31 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:21:31 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:21:31 user nova-compute[75257]:   </cpu>
Nov 14 02:21:31 user nova-compute[75257]:   <devices>
Nov 14 02:21:31 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:21:31 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:21:31 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk"/>
Nov 14 02:21:31 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:21:31 user nova-compute[75257]:     </disk>
Nov 14 02:21:31 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:21:31 user nova-compute[75257]:       <mac address="fa:16:3e:83:d6:15"/>
Nov 14 02:21:31 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:21:31 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:21:31 user nova-compute[75257]:       <target dev="tapa346a6b6-42"/>
Nov 14 02:21:31 user nova-compute[75257]:     </interface>
Nov 14 02:21:31 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:21:31 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/console.log" append="off"/>
Nov 14 02:21:31 user nova-compute[75257]:     </serial>
Nov 14 02:21:31 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:21:31 user nova-compute[75257]:     <video>
Nov 14 02:21:31 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:21:31 user nova-compute[75257]:     </video>
Nov 14 02:21:31 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:21:31 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:21:31 user nova-compute[75257]:     </rng>
Nov 14 02:21:31 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:21:31 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:21:31 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:21:31 user nova-compute[75257]:     </memballoon>
Nov 14 02:21:31 user nova-compute[75257]:   </devices>
Nov 14 02:21:31 user nova-compute[75257]: </domain>
Nov 14 02:21:31 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1137021199',display_name='tempest-VolumesSnapshotTestJSON-instance-1137021199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1137021199',id=37,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4yKgyDK23ewe450iUs1rZwM21NYHFAcoK312eJ7UUkzY/DPknEhw1XJrr03KJO7BTArPrFwXojLXC/Yubfbl/x+1OBc0kBiaNaT0KVcBwhR2dL31ZDEOK1fyYWhqY5ww==',key_name='tempest-keypair-817367158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdd36fad5dd04e79a672f69b7e100ae5',ramdisk_id='',reservation_id='r-lmrz0403',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-408710193',owner_user_name='tempest-VolumesSnapshotTestJSON-408710193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0729cfec73f44f4eafb49d51f9ce01e2',uuid=59e9702c-fd13-497e-abb9-bf85703fccea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converting VIF {"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=a346a6b6-4287-489f-a426-f26a927d153c,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa346a6b6-42') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG os_vif [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=a346a6b6-4287-489f-a426-f26a927d153c,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa346a6b6-42') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e1d2fba-1a9b-58ad-881d-e204495fb9d7', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa346a6b6-42, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa346a6b6-42, col_values=(('qos', UUID('90989b3e-35f9-4436-95d1-46c0a0ab5370')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa346a6b6-42, col_values=(('external_ids', {'iface-id': 'a346a6b6-4287-489f-a426-f26a927d153c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:d6:15', 'vm-uuid': '59e9702c-fd13-497e-abb9-bf85703fccea'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:31 user nova-compute[75257]: INFO os_vif [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=a346a6b6-4287-489f-a426-f26a927d153c,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa346a6b6-42')
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:21:31 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No VIF found with MAC fa:16:3e:83:d6:15, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:21:32 user nova-compute[75257]: DEBUG nova.network.neutron [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Updated VIF entry in instance network info cache for port a346a6b6-4287-489f-a426-f26a927d153c. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:21:32 user nova-compute[75257]: DEBUG nova.network.neutron [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Updating instance_info_cache with network_info: [{"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f7837dcb-b6d7-4816-bb2f-12bc8e991fe7 req-b11b5ef0-59ea-48ba-b491-9dc349ea2202 service nova] Releasing lock "refresh_cache-59e9702c-fd13-497e-abb9-bf85703fccea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:21:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG nova.compute.manager [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received event network-vif-plugged-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG nova.compute.manager [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] No waiting events found dispatching network-vif-plugged-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:21:33 user nova-compute[75257]: WARNING nova.compute.manager [req-2523ef1e-298f-4012-966f-c98ee4ec6952 req-bff0de98-fbd1-4fd4-9a88-96b98240e9d2 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received unexpected event network-vif-plugged-a346a6b6-4287-489f-a426-f26a927d153c for instance with vm_state building and task_state spawning.
Nov 14 02:21:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:21:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Instance spawned successfully.
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received event network-vif-plugged-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] No waiting events found dispatching network-vif-plugged-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:21:35 user nova-compute[75257]: WARNING nova.compute.manager [req-930d673c-3d9a-4295-adca-d8271c4be2bd req-1073b418-8fcb-479b-afbf-3c8fc973cf8c service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received unexpected event network-vif-plugged-a346a6b6-4287-489f-a426-f26a927d153c for instance with vm_state building and task_state spawning.
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:35 user nova-compute[75257]: INFO nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:21:35 user nova-compute[75257]: INFO nova.compute.manager [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Terminating instance
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:35 user nova-compute[75257]: INFO nova.compute.manager [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Took 6.03 seconds to build instance.
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-313fecaa-546d-4906-843e-286df0e538cf tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.129s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-unplugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-unplugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:21:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-230a2e06-3ec6-45e0-9c59-577cff80e2f8 req-d8c284f8-1bcb-495d-b055-2121e3e75fb4 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-unplugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:21:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Instance destroyed successfully.
Nov 14 02:21:36 user nova-compute[75257]: DEBUG nova.objects.instance [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lazy-loading 'resources' on Instance uuid ce3a9680-3062-4e7d-8af3-81c31f3f499c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-164252655',display_name='tempest-ServerActionsTestOtherB-server-164252655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-164252655',id=21,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOnwgMBs2GfnJ3IEyH4UTo/PWUteAm0OqriUl5qwASNHLbNqtXpFMlmWbskunItvTSSugospHPeJd2DVaUSkV1vLe5nvk58oue5N+iihigPisCFTg7ftJbZt+4624OiA==',key_name='tempest-keypair-1362037621',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dcd87f632574f81813bc7606a8fe70e',ramdisk_id='',reservation_id='r-5x0q0qiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2069029360',owner_user_name='tempest-ServerActionsTestOtherB-2069029360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:18:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b73fe859f2604a1bbf70f01587cf015c',uuid=ce3a9680-3062-4e7d-8af3-81c31f3f499c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converting VIF {"id": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "address": "fa:16:3e:40:6e:3c", "network": {"id": "e441a460-c10e-447c-ac80-93a89d0eff62", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2074904170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dcd87f632574f81813bc7606a8fe70e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped73d0a9-0d", "ovs_interfaceid": "ed73d0a9-0d24-470f-9fef-56c5474f0a9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_vif [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped73d0a9-0d, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b54aa4b5-6392-4f71-9b06-701e6d9af738) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:21:36 user nova-compute[75257]: INFO os_vif [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:6e:3c,bridge_name='br-int',has_traffic_filtering=True,id=ed73d0a9-0d24-470f-9fef-56c5474f0a9e,network=Network(e441a460-c10e-447c-ac80-93a89d0eff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped73d0a9-0d')
Nov 14 02:21:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypbaiVoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:21:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7787e10-0241-44c6-b1ee-2ca07f0f2281]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:21:36 user nova-compute[75257]: No targets found.
Nov 14 02:21:36 user nova-compute[75257]: iSNS:
Nov 14 02:21:36 user nova-compute[75257]: No targets found.
Nov 14 02:21:36 user nova-compute[75257]: STATIC:
Nov 14 02:21:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:21:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112
Nov 14 02:21:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:21:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5
Nov 14 02:21:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:21:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb
Nov 14 02:21:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:36 user nova-compute[75257]: FIRMWARE:
Nov 14 02:21:36 user nova-compute[75257]: No targets found.
Nov 14 02:21:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:21:36 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:21:36 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5c4548-73d7-485d-816d-df3072f93075]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6648ca9d-fd5d-4183-afa7-a0b5d83b3c88]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:21:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:21:36 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:21:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb978777640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112'): ({'sdg'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Removing single pathed devices sdg {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e31c15-beba-4d1e-904f-14d3f701483a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c67c8ee-121e-45df-9d04-ce565b8b4014]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Flushing IO for device /dev/sdg {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef958797-17f1-4d83-8800-31d3d19157d3]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e9cf95-dc1f-4c3b-8da8-697a346b318a]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] SCSI volumes sdg have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[357a61e0-fdec-4f31-a101-8c15c0fe2f5e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7981df5-c48c-4c47-ac58-e67187247bf8]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260]
Nov 14 02:21:36 user nova-compute[75257]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112, portal: 172.16.0.220,3260] successful.
Nov 14 02:21:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4786ccd-1c45-41bb-ae1d-76c3e036a112 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[28097fae-8d34-4c17-83a4-8b955c692be6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] <== disconnect_volume: return (334ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:21:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Deleting instance files /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c_del
Nov 14 02:21:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Deletion of /opt/stack/data/nova/instances/ce3a9680-3062-4e7d-8af3-81c31f3f499c_del complete
Nov 14 02:21:36 user nova-compute[75257]: INFO nova.compute.manager [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 02:21:36 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:21:36 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:21:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:37 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:37 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Took 0.68 seconds to deallocate network for instance.
Nov 14 02:21:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] Acquiring lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] No waiting events found dispatching network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:21:37 user nova-compute[75257]: WARNING nova.compute.manager [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received unexpected event network-vif-plugged-ed73d0a9-0d24-470f-9fef-56c5474f0a9e for instance with vm_state active and task_state deleting.
Nov 14 02:21:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-78efa2be-c1c6-4678-b6ea-4f807db29d00 req-59909084-181a-4ceb-acfc-e3396a4d6998 service nova] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Received event network-vif-deleted-ed73d0a9-0d24-470f-9fef-56c5474f0a9e {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:37 user nova-compute[75257]: INFO nova.compute.manager [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] [instance: ce3a9680-3062-4e7d-8af3-81c31f3f499c] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 02:21:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:38 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:21:38 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:21:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:38 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Deleted allocations for instance ce3a9680-3062-4e7d-8af3-81c31f3f499c
Nov 14 02:21:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-843ee6e4-3e67-4a04-9777-1785901d2d5e tempest-ServerActionsTestOtherB-2069029360 tempest-ServerActionsTestOtherB-2069029360-project-member] Lock "ce3a9680-3062-4e7d-8af3-81c31f3f499c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.333s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:39 user nova-compute[75257]: DEBUG nova.compute.manager [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:21:39 user nova-compute[75257]: INFO nova.compute.manager [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] instance snapshotting
Nov 14 02:21:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Beginning live snapshot process
Nov 14 02:21:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json -f qcow2 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json -f qcow2 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.212s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl0_8vaqr/232cbc9953294a3b90780122e745af33.delta 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl0_8vaqr/232cbc9953294a3b90780122e745af33.delta 1073741824" returned: 0 in 0.055s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:40 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 02:21:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:41 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e083a62-27d0-4633-a608-7eb34ddafe2c is timed out.
Nov 14 02:21:41 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully detached device vdb from instance 9e083a62-27d0-4633-a608-7eb34ddafe2c from the live domain config.
Nov 14 02:21:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FMtPQBWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:21:41 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ec94b2-4f22-4f95-9702-6309f4519482]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:21:41 user nova-compute[75257]: No targets found.
Nov 14 02:21:41 user nova-compute[75257]: iSNS:
Nov 14 02:21:41 user nova-compute[75257]: No targets found.
Nov 14 02:21:41 user nova-compute[75257]: STATIC:
Nov 14 02:21:41 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:21:41 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:41 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:41 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:21:41 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:41 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:41 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5
Nov 14 02:21:41 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:41 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:41 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:21:41 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:41 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:41 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb
Nov 14 02:21:41 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:41 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:41 user nova-compute[75257]: FIRMWARE:
Nov 14 02:21:41 user nova-compute[75257]: No targets found.
Nov 14 02:21:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:21:41 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:21:41 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c39ae46-bd2f-4a23-8533-ff7bd8be0985]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40165a7-91a6-4e9b-b594-5d380889fcf3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:21:41 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:21:41 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:21:41 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:21:41 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:21:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:21:41 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:21:41 user nova-compute[75257]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb (non-flash)
Nov 14 02:21:41 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:21:41 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:21:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a41379a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ef1016-c753-4fe8-84c6-a4c72e82715b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb48cde9-e0f2-4359-99c3-975cc7ccb16d]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[71397fdd-65b6-44b6-b39b-2f42507f5f30]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc6bf19-96d8-448b-a425-12dda56a8dcf]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf22c3a0-f0e4-4553-b978-15a5a882c3ad]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75257) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 02:21:41 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaca59f-5f18-4031-a899-7fbe447e559b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb, portal: 172.16.0.220,3260]
Nov 14 02:21:41 user nova-compute[75257]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb, portal: 172.16.0.220,3260] successful.
Nov 14 02:21:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006829f8-9e9b-4d9a-a76a-ed873c5b57fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3836dcfd-7bc2-4dbe-9a1e-3dba437155d2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] <== disconnect_volume: return (386ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:21:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl0_8vaqr/232cbc9953294a3b90780122e745af33.delta /opt/stack/data/nova/instances/snapshots/tmpl0_8vaqr/232cbc9953294a3b90780122e745af33 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl0_8vaqr/232cbc9953294a3b90780122e745af33.delta /opt/stack/data/nova/instances/snapshots/tmpl0_8vaqr/232cbc9953294a3b90780122e745af33" returned: 0 in 0.532s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:42 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Snapshot extracted, beginning image upload
Nov 14 02:21:42 user nova-compute[75257]: DEBUG nova.objects.instance [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'flavor' on Instance uuid 9e083a62-27d0-4633-a608-7eb34ddafe2c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:21:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-becef2eb-da67-4508-ab86-b3e90ea57331 tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.846s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received event network-changed-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Refreshing instance network info cache due to event network-changed-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:21:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] Acquiring lock "refresh_cache-055ad398-aa12-4378-a63a-e2a3562f661e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:21:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] Acquired lock "refresh_cache-055ad398-aa12-4378-a63a-e2a3562f661e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:21:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Refreshing network info cache for port 8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:21:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Updated VIF entry in instance network info cache for port 8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:21:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Updating instance_info_cache with network_info: [{"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bc69a948-79fa-4490-9ed7-f787a64ee3c5 req-017b7e11-5981-4536-aba6-00b3eb5d1c97 service nova] Releasing lock "refresh_cache-055ad398-aa12-4378-a63a-e2a3562f661e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "055ad398-aa12-4378-a63a-e2a3562f661e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "055ad398-aa12-4378-a63a-e2a3562f661e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:44 user nova-compute[75257]: INFO nova.compute.manager [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Terminating instance
Nov 14 02:21:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received event network-vif-unplugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] Acquiring lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] No waiting events found dispatching network-vif-unplugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-e62a7bda-ce7b-48a1-8e05-c0528ed35333 req-1c39d866-4af7-4f72-bb9c-1a8689165382 service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received event network-vif-unplugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Snapshot image upload complete
Nov 14 02:21:44 user nova-compute[75257]: INFO nova.compute.manager [None req-f17b49fb-c9ed-4671-be8c-a1e178d4ff76 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Took 5.19 seconds to snapshot the instance on the hypervisor.
Nov 14 02:21:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Instance destroyed successfully.
Nov 14 02:21:44 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'resources' on Instance uuid 055ad398-aa12-4378-a63a-e2a3562f661e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-655354691',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-655354691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-655354691',id=34,image_ref='7ec1582b-bd06-4bd6-ad74-b5cfd1ffd97b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMfSbaIQjsDXUesX0QJMxpnjVwksnTpxHa42LE+eNaaAX/mAoIPiSgn1p7l9i13oPo6C0FpWOPz7OfXHeP0HYMXBBGYL0SUBqbQg6edWbX6TYbhkpiErBvy9B4KFFcTZQ==',key_name='tempest-keypair-122805512',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:20:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-lj7201hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1633655156',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61052c8663184644aa445e8b29a9d6ed',uuid=055ad398-aa12-4378-a63a-e2a3562f661e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "address": "fa:16:3e:78:27:a4", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2ab5b5-1d", "ovs_interfaceid": "8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:27:a4,bridge_name='br-int',has_traffic_filtering=True,id=8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2ab5b5-1d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_vif [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:27:a4,bridge_name='br-int',has_traffic_filtering=True,id=8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2ab5b5-1d') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e2ab5b5-1d, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9053429d-54b5-4e29-b8de-efbfd6a63a8b) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:44 user nova-compute[75257]: INFO os_vif [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:27:a4,bridge_name='br-int',has_traffic_filtering=True,id=8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2ab5b5-1d')
Nov 14 02:21:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epRvDTUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:21:44 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0dabea-27d8-41b0-8159-6a7a66b1b452]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:21:44 user nova-compute[75257]: No targets found.
Nov 14 02:21:44 user nova-compute[75257]: iSNS:
Nov 14 02:21:44 user nova-compute[75257]: No targets found.
Nov 14 02:21:44 user nova-compute[75257]: STATIC:
Nov 14 02:21:44 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:21:44 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:44 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:44 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:21:44 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:44 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:44 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5
Nov 14 02:21:44 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:44 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:44 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:21:44 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:21:44 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:21:44 user nova-compute[75257]: FIRMWARE:
Nov 14 02:21:44 user nova-compute[75257]: No targets found.
Nov 14 02:21:44 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:21:44 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:21:44 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[666a0cb9-9687-4868-91e8-a8742b67475f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a3ca7c-56f4-4f9f-84c1-234f1b7ad456]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:21:44 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:21:44 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:21:44 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:21:44 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:21:44 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:21:44 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:21:44 user nova-compute[75257]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 (non-flash)
Nov 14 02:21:44 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9787764d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff311e5-3f52-4421-b411-6ba49ad87563]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[81167806-d5e1-4cae-8ed4-2c7395d0beb9]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[917e2aa1-dade-4a89-8ab0-02462bb24ca6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:21:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eca691f-05c4-45d7-ba86-4c3c6f21a9b3]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5975caa5-b0a4-4d26-8a19-1811b13641f2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1494eb80-acba-4e4e-963e-fbb5e2ddbb24]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5, portal: 172.16.0.220,3260]
Nov 14 02:21:45 user nova-compute[75257]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5, portal: 172.16.0.220,3260] successful.
Nov 14 02:21:45 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd4a26c6-87c2-4029-b8d5-f9b810606ff5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad511cf1-e445-4614-9d8b-9d2a322d1c2d]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== disconnect_volume: return (343ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:21:45 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Deleting instance files /opt/stack/data/nova/instances/055ad398-aa12-4378-a63a-e2a3562f661e_del
Nov 14 02:21:45 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Deletion of /opt/stack/data/nova/instances/055ad398-aa12-4378-a63a-e2a3562f661e_del complete
Nov 14 02:21:45 user nova-compute[75257]: INFO nova.compute.manager [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 02:21:45 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:21:45 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:21:45 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Took 0.60 seconds to deallocate network for instance.
Nov 14 02:21:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-3aa2abaa-d64a-4b95-a9ea-d5fb4fee1b35 req-f795271b-5e82-4d33-8258-0afeaa549e7d service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received event network-vif-deleted-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received event network-vif-plugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:21:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] Acquiring lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] Lock "055ad398-aa12-4378-a63a-e2a3562f661e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:46 user nova-compute[75257]: DEBUG nova.compute.manager [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] No waiting events found dispatching network-vif-plugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:21:46 user nova-compute[75257]: WARNING nova.compute.manager [req-f9c0a54f-e4b0-434f-85a8-a34ba7799fac req-24540a7c-129a-43a8-9ce9-1b2abd6a7f0e service nova] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Received unexpected event network-vif-plugged-8e2ab5b5-1d35-4258-ae5a-4be59cda5cd2 for instance with vm_state active and task_state deleting.
Nov 14 02:21:46 user nova-compute[75257]: INFO nova.compute.manager [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 02:21:46 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 055ad398-aa12-4378-a63a-e2a3562f661e] Deleting volume: fd4a26c6-87c2-4029-b8d5-f9b810606ff5 {{(pid=75257) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 02:21:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:21:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:21:47 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:21:47 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:21:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:47 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Deleted allocations for instance 055ad398-aa12-4378-a63a-e2a3562f661e
Nov 14 02:21:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b7bb1ca3-a53d-4ed9-9983-2591b2199bb1 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "055ad398-aa12-4378-a63a-e2a3562f661e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.221s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:21:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:21:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:58 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:21:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:22:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updating instance_info_cache with network_info: [{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:22:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:22:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:22:07 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:22:07 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7284MB free_disk=24.97393035888672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 9e083a62-27d0-4633-a608-7eb34ddafe2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 987991d7-8a45-49ee-a516-fac07e1d8589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 14f49370-77df-4e76-8e1d-4f89580315a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 59e9702c-fd13-497e-abb9-bf85703fccea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.742s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:22:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:22:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 42cdcf9f-848c-4960-87ca-3a8afa145b6a {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 9e083a62-27d0-4633-a608-7eb34ddafe2c {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 90d8b16a-a1f1-4625-a715-e5e8bd87d66b {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 987991d7-8a45-49ee-a516-fac07e1d8589 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid ba9ecc12-fe4e-4124-8f4c-2160cd08337b {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 6bc79fc1-8d23-443f-99b5-2464e115a1be {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 59e9702c-fd13-497e-abb9-bf85703fccea {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "987991d7-8a45-49ee-a516-fac07e1d8589" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "987991d7-8a45-49ee-a516-fac07e1d8589" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "987991d7-8a45-49ee-a516-fac07e1d8589" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:12 user nova-compute[75257]: INFO nova.compute.manager [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Terminating instance
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-unplugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-unplugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-d6640f5c-28b7-4770-850c-4c551027d8ac req-ded83b22-186b-419f-acf4-6f6a743daf05 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-unplugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Instance destroyed successfully.
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lazy-loading 'resources' on Instance uuid 9e083a62-27d0-4633-a608-7eb34ddafe2c {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-417851207',display_name='tempest-TestMinimumBasicScenario-server-417851207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-417851207',id=29,image_ref='948f42ca-5bd2-49c0-b496-c1902fa97d96',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Qai4/c8jmrXF+7sKrGwGzLpkwduY4d7UGfz12nhhhboF8T7Ehv+HP+Y/q9Ste7wY5aWF97tpO6Jn7SyB48wCDuYBRmb0sUQHOXHaWm+kkFbHfcXXqC4LxndEphuYhLw==',key_name='tempest-TestMinimumBasicScenario-1262712773',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cfe231fae1941f4970c17e344df8b81',ramdisk_id='',reservation_id='r-gnye2bln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='948f42ca-5bd2-49c0-b496-c1902fa97d96',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1293674307',owner_user_name='tempest-TestMinimumBasicScenario-1293674307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:19:36Z,user_data=None,user_id='87f69eeadbaf45bfa01dfdfa5efcccb3',uuid=9e083a62-27d0-4633-a608-7eb34ddafe2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converting VIF {"id": "fb569262-fb03-4fa0-9d3d-80ab79690476", "address": "fa:16:3e:4d:0d:51", "network": {"id": "48fae5b7-e614-4e23-9424-98dec9f9eab6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1594885852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cfe231fae1941f4970c17e344df8b81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb569262-fb", "ovs_interfaceid": "fb569262-fb03-4fa0-9d3d-80ab79690476", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:0d:51,bridge_name='br-int',has_traffic_filtering=True,id=fb569262-fb03-4fa0-9d3d-80ab79690476,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb569262-fb') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG os_vif [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:0d:51,bridge_name='br-int',has_traffic_filtering=True,id=fb569262-fb03-4fa0-9d3d-80ab79690476,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb569262-fb') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb569262-fb, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf4c5409-a31c-4c09-aa9c-e5531bd61d73) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:12 user nova-compute[75257]: INFO os_vif [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:0d:51,bridge_name='br-int',has_traffic_filtering=True,id=fb569262-fb03-4fa0-9d3d-80ab79690476,network=Network(48fae5b7-e614-4e23-9424-98dec9f9eab6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb569262-fb')
Nov 14 02:22:12 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Deleting instance files /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c_del
Nov 14 02:22:12 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Deletion of /opt/stack/data/nova/instances/9e083a62-27d0-4633-a608-7eb34ddafe2c_del complete
Nov 14 02:22:12 user nova-compute[75257]: INFO nova.compute.manager [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 02:22:12 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:22:12 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:13 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Took 0.44 seconds to deallocate network for instance.
Nov 14 02:22:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-afa5cd9d-0f6a-4f92-8695-847f23858282 req-ed157ff5-aaf6-49b8-aa50-5ba6e960c2df service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-deleted-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:22:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:13 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Deleted allocations for instance 9e083a62-27d0-4633-a608-7eb34ddafe2c
Nov 14 02:22:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0dd80ee9-5bd6-428a-b940-b196ec63a0ce tempest-TestMinimumBasicScenario-1293674307 tempest-TestMinimumBasicScenario-1293674307-project-member] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.905s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:14 user nova-compute[75257]: WARNING nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state deleted and task_state None.
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:14 user nova-compute[75257]: WARNING nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state deleted and task_state None.
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:14 user nova-compute[75257]: WARNING nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state deleted and task_state None.
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-unplugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-unplugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:14 user nova-compute[75257]: WARNING nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-unplugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state deleted and task_state None.
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Acquiring lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] Lock "9e083a62-27d0-4633-a608-7eb34ddafe2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] No waiting events found dispatching network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:14 user nova-compute[75257]: WARNING nova.compute.manager [req-8324c67a-0d19-47b5-a809-026766758e8e req-e1a1afde-5232-4fab-9b29-7f6422184ea0 service nova] [instance: 9e083a62-27d0-4633-a608-7eb34ddafe2c] Received unexpected event network-vif-plugged-fb569262-fb03-4fa0-9d3d-80ab79690476 for instance with vm_state deleted and task_state None.
Nov 14 02:22:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-changed-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Refreshing instance network info cache due to event network-changed-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:22:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] Acquiring lock "refresh_cache-6bc79fc1-8d23-443f-99b5-2464e115a1be" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] Acquired lock "refresh_cache-6bc79fc1-8d23-443f-99b5-2464e115a1be" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:34 user nova-compute[75257]: DEBUG nova.network.neutron [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Refreshing network info cache for port b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG nova.network.neutron [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Updated VIF entry in instance network info cache for port b08dac99-5ce4-4efa-bf90-82b90a1ca4c7. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG nova.network.neutron [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Updating instance_info_cache with network_info: [{"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1adfa99f-898a-4b46-b9d0-a7483e3b412b req-463fe7b9-f7bc-48c0-a122-4c4e762bf561 service nova] Releasing lock "refresh_cache-6bc79fc1-8d23-443f-99b5-2464e115a1be" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "987991d7-8a45-49ee-a516-fac07e1d8589" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "987991d7-8a45-49ee-a516-fac07e1d8589" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "987991d7-8a45-49ee-a516-fac07e1d8589-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "987991d7-8a45-49ee-a516-fac07e1d8589-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "987991d7-8a45-49ee-a516-fac07e1d8589-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:35 user nova-compute[75257]: INFO nova.compute.manager [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Terminating instance
Nov 14 02:22:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'flavor' on Instance uuid 6bc79fc1-8d23-443f-99b5-2464e115a1be {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:22:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Instance destroyed successfully.
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.objects.instance [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'resources' on Instance uuid 987991d7-8a45-49ee-a516-fac07e1d8589 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1353021008',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1353021008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1353021008',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/+9CMLVpa/whcV4Tg4EhYx30XdEKCDGSZ2vFlN/0qq0gnew7RwjUilCukmZaf3/GXHbwxxxJNSxoEdKvsjjv2zhfLMlAbt82+zEF9wGzEhk9GhqMsdkL8/VTPKHfp1WQ==',key_name='tempest-keypair-1627011863',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:18:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-608haspc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:18:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61052c8663184644aa445e8b29a9d6ed',uuid=987991d7-8a45-49ee-a516-fac07e1d8589,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "address": "fa:16:3e:11:5c:45", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f087bec-f4", "ovs_interfaceid": "3f087bec-f4a3-4cc7-85a4-bbc27914cbae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:5c:45,bridge_name='br-int',has_traffic_filtering=True,id=3f087bec-f4a3-4cc7-85a4-bbc27914cbae,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f087bec-f4') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_vif [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:5c:45,bridge_name='br-int',has_traffic_filtering=True,id=3f087bec-f4a3-4cc7-85a4-bbc27914cbae,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f087bec-f4') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f087bec-f4, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7b89757-cda7-4df4-99a4-d1ea1ad3aff2) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:36 user nova-compute[75257]: INFO os_vif [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:5c:45,bridge_name='br-int',has_traffic_filtering=True,id=3f087bec-f4a3-4cc7-85a4-bbc27914cbae,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f087bec-f4')
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKoAHZxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:22:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5047b7-dbf3-4be0-8e34-08f3614448f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:22:36 user nova-compute[75257]: No targets found.
Nov 14 02:22:36 user nova-compute[75257]: iSNS:
Nov 14 02:22:36 user nova-compute[75257]: No targets found.
Nov 14 02:22:36 user nova-compute[75257]: STATIC:
Nov 14 02:22:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:22:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:22:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:22:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359
Nov 14 02:22:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:22:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:22:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:22:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:22:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:22:36 user nova-compute[75257]: FIRMWARE:
Nov 14 02:22:36 user nova-compute[75257]: No targets found.
Nov 14 02:22:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:22:36 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:22:36 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e1375-68ed-4ea6-8e79-52d6dde58c9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcb7339-1cf7-430a-bc66-70ce7e5bf529]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:36 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:22:36 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:36 user nova-compute[75257]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 (non-flash)
Nov 14 02:22:36 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a4298700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359'): ({'sde'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Removing single pathed devices sde {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d0e3f-fc15-48be-9e66-89652b344c83]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c05396-2030-4d0a-ae70-f3680e23ab74]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flushing IO for device /dev/sde {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0e5186-37e3-485b-a302-1ecc4eedc08a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:36 user nova-compute[75257]: INFO nova.compute.manager [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Attaching volume 22b7d354-46a0-4057-ba2c-bf04b07c31e4 to /dev/vdb
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0212fe-8b5c-46e7-a241-9bbd03c3c92a]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO19d20d91-e3712f4bfb64c4fb', '/dev/disk/by-id/scsi-26533373132663462', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_19d20d91') {{(pid=85764) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcc0b59-3054-4ee8-bd25-734565249dc3]: (4, None) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[72afc703-5df2-4f60-a65c-7bb8a1d0b89b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.utils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fcf99a-0ef3-4d70-91a5-1af312790084]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[502b9cde-b154-4603-a804-bcbd0e6932a1]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[419f740e-8d0c-4188-8c8d-c0ca05e60889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359, portal: 172.16.0.220,3260]
Nov 14 02:22:36 user nova-compute[75257]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359, portal: 172.16.0.220,3260] successful.
Nov 14 02:22:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcba1ed-5ea7-4bd4-8acf-b0ace21fba8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46354624-906b-41f0-bf9d-b1a415b27359 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6efdd77-43eb-400f-9857-80512193fbfc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== disconnect_volume: return (347ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:22:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Deleting instance files /opt/stack/data/nova/instances/987991d7-8a45-49ee-a516-fac07e1d8589_del
Nov 14 02:22:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Deletion of /opt/stack/data/nova/instances/987991d7-8a45-49ee-a516-fac07e1d8589_del complete
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1ca32-580c-4e52-9663-4b8957f9b6f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:22:36 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be9a91-5668-4297-9fab-73ff5cca176f]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG os_brick.utils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Updating existing volume attachment record: 9fa8ee38-4cfa-451f-b6a7-b1e0029af41d {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:22:36 user nova-compute[75257]: INFO nova.compute.manager [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 02:22:36 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:22:36 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:22:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:38 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Received event network-vif-deleted-3f087bec-f4a3-4cc7-85a4-bbc27914cbae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:38 user nova-compute[75257]: INFO nova.compute.manager [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Neutron deleted interface 3f087bec-f4a3-4cc7-85a4-bbc27914cbae; detaching it from the instance and deleting it from the info cache
Nov 14 02:22:38 user nova-compute[75257]: DEBUG nova.network.neutron [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:38 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Took 1.30 seconds to deallocate network for instance.
Nov 14 02:22:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-c31e5dd5-cf39-4612-862f-a54874590cc9 req-e053cd03-f55e-4023-8778-e70599594799 service nova] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Detach interface failed, port_id=3f087bec-f4a3-4cc7-85a4-bbc27914cbae, reason: Instance 987991d7-8a45-49ee-a516-fac07e1d8589 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:22:38 user nova-compute[75257]: INFO nova.compute.manager [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 02:22:38 user nova-compute[75257]: DEBUG nova.compute.manager [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 987991d7-8a45-49ee-a516-fac07e1d8589] Deleting volume: 46354624-906b-41f0-bf9d-b1a415b27359 {{(pid=75257) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 02:22:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:39 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:22:39 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:22:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:39 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Deleted allocations for instance 987991d7-8a45-49ee-a516-fac07e1d8589
Nov 14 02:22:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46051407-f54b-41c9-ba27-6dacdfe13328 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "987991d7-8a45-49ee-a516-fac07e1d8589" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.877s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTRbjdAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:22:41 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:22:41 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:22:41 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83753c2-e4d0-45fe-a40a-17fc32d0b8f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:22:41 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6590785a-f73d-48c0-997f-dd760deed1e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4] added
Nov 14 02:22:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8218b6c-6c95-4934-ad43-be2a76743c94]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a149f4-6dc4-49e1-ad7e-077f061fdea1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTRbjdAV {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTRbjdAV" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecade977-b7b2-4257-85b1-e1f055bae769]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZTRbjdAV'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcf1aa1-5bfc-4060-903f-45ad08ca3529]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5101fe93-ec1b-4cdb-9138-eaad467c9825]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:41 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:41 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:22:41 user nova-compute[75257]: INFO nova.compute.claims [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Claim successful on node user
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26bf902-aafa-4fc1-81b3-f732d2239db0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4, portal: 172.16.0.220,3260]
Nov 14 02:22:41 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4, portal: 172.16.0.220,3260] successful.
Nov 14 02:22:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9962aa28-5807-47ac-a585-b9fba5bbf009]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9952caee-78b3-45fa-a574-88378c7e387a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:41 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:41 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:41 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:41 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5fcaaa-e85e-426c-bbe7-99193e6e53dd]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:22:41 user nova-compute[75257]: DEBUG nova.network.neutron [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:22:41 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:22:41 user nova-compute[75257]: DEBUG nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.policy [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:22:42 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Creating image(s)
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.224s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk 1073741824" returned: 0 in 0.050s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.network.neutron [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Successfully created port: cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTRbjdAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23566316331336364', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566316331336364', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'flavor' on Instance uuid 6bc79fc1-8d23-443f-99b5-2464e115a1be {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:22:42 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:22:42 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:22:42 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:22:42 user nova-compute[75257]:   <serial>22b7d354-46a0-4057-ba2c-bf04b07c31e4</serial>
Nov 14 02:22:42 user nova-compute[75257]: </disk>
Nov 14 02:22:42 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.168s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Cannot resize image /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Ensure instance console log exists: /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No VIF found with MAC fa:16:3e:cd:53:b7, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f8f55276-b5b5-4e45-b5b9-4fde5f373558 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.608s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.neutron [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Successfully updated port: cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquired lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.neutron [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-changed-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Refreshing instance network info cache due to event network-changed-cd7b2500-ad09-43fc-ad92-8338dc32fcbe. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] Acquiring lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.neutron [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.neutron [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating instance_info_cache with network_info: [{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Releasing lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance network_info: |[{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] Acquired lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Refreshing network info cache for port cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Start _get_guest_xml network_info=[{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:22:43 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:22:43 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432527132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432527132',id=38,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDtiB1Q/29INzS1Awe+SrgWEvNOe4OsR9c2+ytcV4I9qNI9t4UTFZ3vYkj4sjWDTElkVGfSPjrpMOIeYBmbQit22H7RXOnJXqzHe8TWNNfea+Locbv+beA3JPiwlKqB5A==',key_name='tempest-keypair-1542235845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-xuuad11y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:22:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=f3c72a5a-0bce-4ebe-b2da-61f7f08155cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'pci_devices' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:22:43 user nova-compute[75257]:   <uuid>f3c72a5a-0bce-4ebe-b2da-61f7f08155cc</uuid>
Nov 14 02:22:43 user nova-compute[75257]:   <name>instance-00000026</name>
Nov 14 02:22:43 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:22:43 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:22:43 user nova-compute[75257]:   <metadata>
Nov 14 02:22:43 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:22:43 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:22:43 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-432527132</nova:name>
Nov 14 02:22:43 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:22:43</nova:creationTime>
Nov 14 02:22:43 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:22:43 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:22:43 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:22:43 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:22:43 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:22:43 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:22:43 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:22:43 user nova-compute[75257]:       <nova:owner>
Nov 14 02:22:43 user nova-compute[75257]:         <nova:user uuid="d50e0e5a436243f2a91c012a4996185c">tempest-AttachVolumeShelveTestJSON-1725343669-project-member</nova:user>
Nov 14 02:22:43 user nova-compute[75257]:         <nova:project uuid="4c246fb95dcc49fd910ec526b1977fc8">tempest-AttachVolumeShelveTestJSON-1725343669</nova:project>
Nov 14 02:22:43 user nova-compute[75257]:       </nova:owner>
Nov 14 02:22:43 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:22:43 user nova-compute[75257]:       <nova:ports>
Nov 14 02:22:43 user nova-compute[75257]:         <nova:port uuid="cd7b2500-ad09-43fc-ad92-8338dc32fcbe">
Nov 14 02:22:43 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 02:22:43 user nova-compute[75257]:         </nova:port>
Nov 14 02:22:43 user nova-compute[75257]:       </nova:ports>
Nov 14 02:22:43 user nova-compute[75257]:     </nova:instance>
Nov 14 02:22:43 user nova-compute[75257]:   </metadata>
Nov 14 02:22:43 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:22:43 user nova-compute[75257]:     <system>
Nov 14 02:22:43 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:22:43 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:22:43 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:22:43 user nova-compute[75257]:       <entry name="serial">f3c72a5a-0bce-4ebe-b2da-61f7f08155cc</entry>
Nov 14 02:22:43 user nova-compute[75257]:       <entry name="uuid">f3c72a5a-0bce-4ebe-b2da-61f7f08155cc</entry>
Nov 14 02:22:43 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:22:43 user nova-compute[75257]:     </system>
Nov 14 02:22:43 user nova-compute[75257]:   </sysinfo>
Nov 14 02:22:43 user nova-compute[75257]:   <os>
Nov 14 02:22:43 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:22:43 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:22:43 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:22:43 user nova-compute[75257]:   </os>
Nov 14 02:22:43 user nova-compute[75257]:   <features>
Nov 14 02:22:43 user nova-compute[75257]:     <acpi/>
Nov 14 02:22:43 user nova-compute[75257]:     <apic/>
Nov 14 02:22:43 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:22:43 user nova-compute[75257]:   </features>
Nov 14 02:22:43 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:22:43 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:22:43 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:22:43 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:22:43 user nova-compute[75257]:   </clock>
Nov 14 02:22:43 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:22:43 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:22:43 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:22:43 user nova-compute[75257]:   </cpu>
Nov 14 02:22:43 user nova-compute[75257]:   <devices>
Nov 14 02:22:43 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:22:43 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:22:43 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk"/>
Nov 14 02:22:43 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:22:43 user nova-compute[75257]:     </disk>
Nov 14 02:22:43 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:22:43 user nova-compute[75257]:       <mac address="fa:16:3e:b3:1c:83"/>
Nov 14 02:22:43 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:22:43 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:22:43 user nova-compute[75257]:       <target dev="tapcd7b2500-ad"/>
Nov 14 02:22:43 user nova-compute[75257]:     </interface>
Nov 14 02:22:43 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:22:43 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/console.log" append="off"/>
Nov 14 02:22:43 user nova-compute[75257]:     </serial>
Nov 14 02:22:43 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:22:43 user nova-compute[75257]:     <video>
Nov 14 02:22:43 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:22:43 user nova-compute[75257]:     </video>
Nov 14 02:22:43 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:22:43 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:22:43 user nova-compute[75257]:     </rng>
Nov 14 02:22:43 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:22:43 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:22:43 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:22:43 user nova-compute[75257]:     </memballoon>
Nov 14 02:22:43 user nova-compute[75257]:   </devices>
Nov 14 02:22:43 user nova-compute[75257]: </domain>
Nov 14 02:22:43 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432527132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432527132',id=38,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDtiB1Q/29INzS1Awe+SrgWEvNOe4OsR9c2+ytcV4I9qNI9t4UTFZ3vYkj4sjWDTElkVGfSPjrpMOIeYBmbQit22H7RXOnJXqzHe8TWNNfea+Locbv+beA3JPiwlKqB5A==',key_name='tempest-keypair-1542235845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-xuuad11y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:22:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=f3c72a5a-0bce-4ebe-b2da-61f7f08155cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG os_vif [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb14b83a-3202-5e03-b7aa-ef8943370e08', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd7b2500-ad, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd7b2500-ad, col_values=(('qos', UUID('dc00f5b7-a236-4144-897c-6d7e6658eda5')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd7b2500-ad, col_values=(('external_ids', {'iface-id': 'cd7b2500-ad09-43fc-ad92-8338dc32fcbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:1c:83', 'vm-uuid': 'f3c72a5a-0bce-4ebe-b2da-61f7f08155cc'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:43 user nova-compute[75257]: INFO os_vif [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad')
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] No VIF found with MAC fa:16:3e:b3:1c:83, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updated VIF entry in instance network info cache for port cd7b2500-ad09-43fc-ad92-8338dc32fcbe. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating instance_info_cache with network_info: [{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5aac8f3c-e562-4393-8eb8-5f733fffc43b req-023266a1-95cf-4f7f-8f78-2acf8adf19f2 service nova] Releasing lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] No waiting events found dispatching network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:45 user nova-compute[75257]: WARNING nova.compute.manager [req-9357c43f-3c19-464b-817c-2d5a6a5d2935 req-b3a6e4ad-53ed-4cbe-afb9-ee8ffb6b7853 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received unexpected event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance with vm_state building and task_state spawning.
Nov 14 02:22:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:22:47 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance spawned successfully.
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "cbecb74e-b1af-404a-9fd6-050328413cac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:22:47 user nova-compute[75257]: INFO nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:22:47 user nova-compute[75257]: INFO nova.compute.claims [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Claim successful on node user
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:47 user nova-compute[75257]: INFO nova.compute.manager [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Took 5.84 seconds to build instance.
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d0cae17c-d922-4efc-a2af-dce90b9426b8 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.940s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] No waiting events found dispatching network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:47 user nova-compute[75257]: WARNING nova.compute.manager [req-3e8a2f60-8f0b-409e-b5ab-bc72921b4aed req-989bfb02-e46d-4b42-b686-19008292afd7 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received unexpected event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance with vm_state active and task_state None.
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.403s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:22:47 user nova-compute[75257]: INFO nova.compute.claims [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Claim successful on node user
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:22:47 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:22:47 user nova-compute[75257]: INFO nova.virt.block_device [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Booting with volume-backed-image ccff493f-43f6-4683-9bdc-984e861f9bf9 at /dev/vda
Nov 14 02:22:47 user nova-compute[75257]: DEBUG nova.policy [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'addcfdac50de4b03bd3ad3142508edea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac29176de8fc434285721bbb6759966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:22:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.policy [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:22:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Creating image(s)
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "/opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "/opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG nova.network.neutron [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Successfully created port: 109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.211s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk 1073741824" returned: 0 in 0.062s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Successfully created port: 6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.240s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-changed-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Refreshing instance network info cache due to event network-changed-cbd77511-3da8-4b8f-bd1c-bb5e9992f811. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] Acquiring lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] Acquired lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.network.neutron [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Refreshing network info cache for port cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Cannot resize image /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Ensure instance console log exists: /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Successfully updated port: 109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquired lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-changed-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Refreshing instance network info cache due to event network-changed-109d45a8-89e1-43d8-9134-d29c37330e20. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] Acquiring lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Updating instance_info_cache with network_info: [{"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Releasing lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Instance network_info: |[{"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] Acquired lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:49 user nova-compute[75257]: DEBUG nova.network.neutron [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Refreshing network info cache for port 109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updated VIF entry in instance network info cache for port cbd77511-3da8-4b8f-bd1c-bb5e9992f811. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updating instance_info_cache with network_info: [{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-681b1632-27a7-4a70-8410-23d9fc06c014 req-d83ebb2b-1b3d-4342-a841-8171eb876f38 service nova] Releasing lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Updated VIF entry in instance network info cache for port 109d45a8-89e1-43d8-9134-d29c37330e20. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Updating instance_info_cache with network_info: [{"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3ea8c36b-432b-4214-b01a-3f5d75550e8e req-59b8046c-d8cc-4c98-b5b9-5305f09c94db service nova] Releasing lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Successfully updated port: 6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "refresh_cache-dcca61ed-4b5a-4966-8584-bde4f1954eb3" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquired lock "refresh_cache-dcca61ed-4b5a-4966-8584-bde4f1954eb3" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received event network-changed-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Refreshing instance network info cache due to event network-changed-6e087160-8d8f-4fce-8f06-559aa76e24ad. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] Acquiring lock "refresh_cache-dcca61ed-4b5a-4966-8584-bde4f1954eb3" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'flavor' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Updating instance_info_cache with network_info: [{"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:50 user nova-compute[75257]: INFO nova.compute.manager [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Attaching volume fc412155-c035-4969-aa7f-9e1bc62a4e64 to /dev/vdb
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Releasing lock "refresh_cache-dcca61ed-4b5a-4966-8584-bde4f1954eb3" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Instance network_info: |[{"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] Acquired lock "refresh_cache-dcca61ed-4b5a-4966-8584-bde4f1954eb3" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Refreshing network info cache for port 6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Start _get_guest_xml network_info=[{"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:22:50 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:22:50 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1080161757',display_name='tempest-AttachVolumeNegativeTest-server-1080161757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1080161757',id=40,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyP+oGtxHij1jDu5knyUXkkhCO10Kr3wgx1E+1ZMdIoetrpAJi7/mDioMn2T01vMWyRKhkVoaQnkrepY+1+EoZehy+AI67In10R7oubX4qC0uKjONiArFcfumG/sW8TlA==',key_name='tempest-keypair-534394893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-qj2paako',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=dcca61ed-4b5a-4966-8584-bde4f1954eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e087160-8d8f-4fce-8f06-559aa76e24ad,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e087160-8d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'pci_devices' on Instance uuid dcca61ed-4b5a-4966-8584-bde4f1954eb3 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG os_brick.utils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:22:50 user nova-compute[75257]:   <uuid>dcca61ed-4b5a-4966-8584-bde4f1954eb3</uuid>
Nov 14 02:22:50 user nova-compute[75257]:   <name>instance-00000028</name>
Nov 14 02:22:50 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:22:50 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:22:50 user nova-compute[75257]:   <metadata>
Nov 14 02:22:50 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:22:50 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:22:50 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1080161757</nova:name>
Nov 14 02:22:50 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:22:50</nova:creationTime>
Nov 14 02:22:50 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:22:50 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:22:50 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:22:50 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:22:50 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:22:50 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:22:50 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:22:50 user nova-compute[75257]:       <nova:owner>
Nov 14 02:22:50 user nova-compute[75257]:         <nova:user uuid="ca8f18684c914e9f93d16df39763743e">tempest-AttachVolumeNegativeTest-1714659318-project-member</nova:user>
Nov 14 02:22:50 user nova-compute[75257]:         <nova:project uuid="bb0268a9065e45f5978c20365956e369">tempest-AttachVolumeNegativeTest-1714659318</nova:project>
Nov 14 02:22:50 user nova-compute[75257]:       </nova:owner>
Nov 14 02:22:50 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:22:50 user nova-compute[75257]:       <nova:ports>
Nov 14 02:22:50 user nova-compute[75257]:         <nova:port uuid="6e087160-8d8f-4fce-8f06-559aa76e24ad">
Nov 14 02:22:50 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 02:22:50 user nova-compute[75257]:         </nova:port>
Nov 14 02:22:50 user nova-compute[75257]:       </nova:ports>
Nov 14 02:22:50 user nova-compute[75257]:     </nova:instance>
Nov 14 02:22:50 user nova-compute[75257]:   </metadata>
Nov 14 02:22:50 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:22:50 user nova-compute[75257]:     <system>
Nov 14 02:22:50 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:22:50 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:22:50 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:22:50 user nova-compute[75257]:       <entry name="serial">dcca61ed-4b5a-4966-8584-bde4f1954eb3</entry>
Nov 14 02:22:50 user nova-compute[75257]:       <entry name="uuid">dcca61ed-4b5a-4966-8584-bde4f1954eb3</entry>
Nov 14 02:22:50 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:22:50 user nova-compute[75257]:     </system>
Nov 14 02:22:50 user nova-compute[75257]:   </sysinfo>
Nov 14 02:22:50 user nova-compute[75257]:   <os>
Nov 14 02:22:50 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:22:50 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:22:50 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:22:50 user nova-compute[75257]:   </os>
Nov 14 02:22:50 user nova-compute[75257]:   <features>
Nov 14 02:22:50 user nova-compute[75257]:     <acpi/>
Nov 14 02:22:50 user nova-compute[75257]:     <apic/>
Nov 14 02:22:50 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:22:50 user nova-compute[75257]:   </features>
Nov 14 02:22:50 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:22:50 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:22:50 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:22:50 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:22:50 user nova-compute[75257]:   </clock>
Nov 14 02:22:50 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:22:50 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:22:50 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:22:50 user nova-compute[75257]:   </cpu>
Nov 14 02:22:50 user nova-compute[75257]:   <devices>
Nov 14 02:22:50 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:22:50 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:22:50 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk"/>
Nov 14 02:22:50 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:22:50 user nova-compute[75257]:     </disk>
Nov 14 02:22:50 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:22:50 user nova-compute[75257]:       <mac address="fa:16:3e:eb:16:2d"/>
Nov 14 02:22:50 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:22:50 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:22:50 user nova-compute[75257]:       <target dev="tap6e087160-8d"/>
Nov 14 02:22:50 user nova-compute[75257]:     </interface>
Nov 14 02:22:50 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:22:50 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/console.log" append="off"/>
Nov 14 02:22:50 user nova-compute[75257]:     </serial>
Nov 14 02:22:50 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:22:50 user nova-compute[75257]:     <video>
Nov 14 02:22:50 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:22:50 user nova-compute[75257]:     </video>
Nov 14 02:22:50 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:22:50 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:22:50 user nova-compute[75257]:     </rng>
Nov 14 02:22:50 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:22:50 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:22:50 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:22:50 user nova-compute[75257]:     </memballoon>
Nov 14 02:22:50 user nova-compute[75257]:   </devices>
Nov 14 02:22:50 user nova-compute[75257]: </domain>
Nov 14 02:22:50 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1080161757',display_name='tempest-AttachVolumeNegativeTest-server-1080161757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1080161757',id=40,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyP+oGtxHij1jDu5knyUXkkhCO10Kr3wgx1E+1ZMdIoetrpAJi7/mDioMn2T01vMWyRKhkVoaQnkrepY+1+EoZehy+AI67In10R7oubX4qC0uKjONiArFcfumG/sW8TlA==',key_name='tempest-keypair-534394893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-qj2paako',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=dcca61ed-4b5a-4966-8584-bde4f1954eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e087160-8d8f-4fce-8f06-559aa76e24ad,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e087160-8d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG os_vif [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e087160-8d8f-4fce-8f06-559aa76e24ad,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e087160-8d') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb10b777-e731-547e-b725-388ee30d5cde', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef1550e-013a-43f7-bbb5-5b790bc07cc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e087160-8d, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e087160-8d, col_values=(('qos', UUID('c44bd350-9f65-4d60-ad80-da670a44d370')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e087160-8d, col_values=(('external_ids', {'iface-id': '6e087160-8d8f-4fce-8f06-559aa76e24ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:16:2d', 'vm-uuid': 'dcca61ed-4b5a-4966-8584-bde4f1954eb3'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b21cb2-4746-451a-8e33-15688acfe931]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:51 user nova-compute[75257]: INFO os_vif [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e087160-8d8f-4fce-8f06-559aa76e24ad,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e087160-8d')
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e41839-aee6-4973-a3f8-236d6bb37f55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3501b227-a728-4c9d-9026-d53d2807d304]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:22:51 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[03170e55-11d4-4aa7-a9f7-554b5240bf7b]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG os_brick.utils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updating existing volume attachment record: 389cc920-6085-4407-bce9-1ffb96543a26 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No VIF found with MAC fa:16:3e:eb:16:2d, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Updated VIF entry in instance network info cache for port 6e087160-8d8f-4fce-8f06-559aa76e24ad. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Updating instance_info_cache with network_info: [{"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4eb9c963-2fab-49bb-9236-047f3267b15b req-1eea1d5f-8777-4ba9-ab1d-b2032cfab386 service nova] Releasing lock "refresh_cache-dcca61ed-4b5a-4966-8584-bde4f1954eb3" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received event network-vif-plugged-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] Acquiring lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] No waiting events found dispatching network-vif-plugged-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:52 user nova-compute[75257]: WARNING nova.compute.manager [req-8103ee96-cbcb-497a-b485-deddba612981 req-ca8c4c75-7b75-4382-ad37-11663d3c31e4 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received unexpected event network-vif-plugged-6e087160-8d8f-4fce-8f06-559aa76e24ad for instance with vm_state building and task_state spawning.
Nov 14 02:22:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG os_brick.utils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8a8c94-bd58-4840-b142-666c7fc2ec9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b932f5-f1c0-418f-8405-7f3ecd5e12a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d36fb0a-2e4d-4f5d-aee1-d85d5f66faf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a348eec4-1f8e-4e20-a656-1360ac970a4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:22:53 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:22:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f96307-b136-41b2-ba34-b7bd15e45515]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG os_brick.utils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:22:53 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Updating existing volume attachment record: 8ee8040e-22ef-43ef-aa8e-f29a2de5a867 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:22:54 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Instance spawned successfully.
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:22:54 user nova-compute[75257]: INFO nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received event network-vif-plugged-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] Acquiring lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] No waiting events found dispatching network-vif-plugged-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:54 user nova-compute[75257]: WARNING nova.compute.manager [req-f8af0260-948a-4918-95b8-55840eae9c78 req-b05bfe89-31f0-441b-8843-001bf473ac59 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received unexpected event network-vif-plugged-6e087160-8d8f-4fce-8f06-559aa76e24ad for instance with vm_state building and task_state spawning.
Nov 14 02:22:54 user nova-compute[75257]: INFO nova.compute.manager [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Took 7.48 seconds to build instance.
Nov 14 02:22:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0ba2f9ef-af57-4515-a0e7-1e0808bad234 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.592s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwzRqMtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:22:55 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:22:55 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:22:55 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1491bad0-ee5d-493c-9874-08fbe255759f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:22:55 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b782507e-6214-481e-aec6-3b1ea2b8840f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64] added
Nov 14 02:22:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7322a90-ec58-4b5c-8048-f94ab4405232]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de1714a-20cd-4c66-b9e0-b47512347c17]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwzRqMtB {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwzRqMtB" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8aa0e4-371f-4d96-bf50-85db6904e8d0]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mwzRqMtB'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d060589a-66b5-4d8d-abac-d86de7792e51]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1002b5ad-b6a4-4e8b-964e-48512cd96d2d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[44407b97-808b-42db-9a73-1149d56e5722]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64, portal: 172.16.0.220,3260]
Nov 14 02:22:55 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64, portal: 172.16.0.220,3260] successful.
Nov 14 02:22:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd5c754-3d28-4171-aeba-8d6effa1f3aa]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d17592-8131-4071-a207-2b54f325a956]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:22:55 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed164737-0b2c-44c2-b605-8cd53f6c498b]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwzRqMtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:22:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:22:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23635663836643665', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:22:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635663836643665', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:22:56 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'flavor' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:22:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:22:56 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:22:56 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:22:56 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:22:56 user nova-compute[75257]:   <serial>fc412155-c035-4969-aa7f-9e1bc62a4e64</serial>
Nov 14 02:22:56 user nova-compute[75257]: </disk>
Nov 14 02:22:56 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:22:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:22:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:22:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No VIF found with MAC fa:16:3e:14:b4:b9, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:22:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ad986ebf-8d40-4e07-adf0-06f34774d136 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.528s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:57 user nova-compute[75257]: INFO nova.compute.manager [None req-fd6452a7-9d49-44b8-b2c7-8a4cd152d553 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Get console output
Nov 14 02:22:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:57 user nova-compute[75257]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:22:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Creating image(s)
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Ensure instance console log exists: /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Start _get_guest_xml network_info=[{"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8ee8040e-22ef-43ef-aa8e-f29a2de5a867', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFpxJTIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cbecb74e-b1af-404a-9fd6-050328413cac', 'attached_at': '', 'detached_at': '', 'volume_id': '515fd521-1fd4-4c68-aef5-5916661c86b0', 'serial': '515fd521-1fd4-4c68-aef5-5916661c86b0'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:22:58 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:22:58 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFpxJTIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:22:58 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:22:58 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:22:58 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b0e02c-0cc1-4184-b97f-6638d78c4bc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:22:58 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7473cf31-8a43-4fdc-bb1e-f66eeb3b1e42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0] added
Nov 14 02:22:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fecf49-7454-4468-9c9a-e5c292560ea1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[df285993-2bc1-4831-814a-0e3535c01b15]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cFpxJTIs {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: INFO nova.compute.manager [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Rescuing
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquired lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cFpxJTIs" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1c052-b770-41e2-bec8-52fed03c3c7b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cFpxJTIs'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96e0747-5c79-42e6-98da-5eb14b0a0ec3]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47096df-e7e0-43f0-a262-9f9b9cd71321]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da75d34-6401-4b14-ae9d-6ba23660c0cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0, portal: 172.16.0.220,3260]
Nov 14 02:22:58 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0, portal: 172.16.0.220,3260] successful.
Nov 14 02:22:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[909748bd-791b-40cf-94c6-516082b2851e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53f5a7d-620e-442f-b922-b41843dff13c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:22:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce51486-0fcc-455b-ad3c-47f32431378f]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:22:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFpxJTIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updating instance_info_cache with network_info: [{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Releasing lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-unplugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-unplugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:22:59 user nova-compute[75257]: WARNING nova.compute.manager [req-da115f8d-e75c-400d-96c0-8320cfddd25c req-09381e0a-57a5-4b24-8372-3d8d1bfc970b service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-unplugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state active and task_state rescuing.
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23138623730633866', 'path': '/dev/sde'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138623730633866', 'path': '/dev/sde'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-893670019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-893670019',id=39,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-xoef4f6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:22:48Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=cbecb74e-b1af-404a-9fd6-050328413cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:51:7f,bridge_name='br-int',has_traffic_filtering=True,id=109d45a8-89e1-43d8-9134-d29c37330e20,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109d45a8-89') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.objects.instance [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'pci_devices' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:22:59 user nova-compute[75257]:   <uuid>cbecb74e-b1af-404a-9fd6-050328413cac</uuid>
Nov 14 02:22:59 user nova-compute[75257]:   <name>instance-00000027</name>
Nov 14 02:22:59 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:22:59 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:22:59 user nova-compute[75257]:   <metadata>
Nov 14 02:22:59 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:22:59 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:22:59 user nova-compute[75257]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-893670019</nova:name>
Nov 14 02:22:59 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:22:58</nova:creationTime>
Nov 14 02:22:59 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:22:59 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:22:59 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:22:59 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:22:59 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:22:59 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:22:59 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:22:59 user nova-compute[75257]:       <nova:owner>
Nov 14 02:22:59 user nova-compute[75257]:         <nova:user uuid="addcfdac50de4b03bd3ad3142508edea">tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member</nova:user>
Nov 14 02:22:59 user nova-compute[75257]:         <nova:project uuid="ac29176de8fc434285721bbb6759966d">tempest-ServerBootFromVolumeStableRescueTest-1355021813</nova:project>
Nov 14 02:22:59 user nova-compute[75257]:       </nova:owner>
Nov 14 02:22:59 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:22:59 user nova-compute[75257]:       <nova:ports>
Nov 14 02:22:59 user nova-compute[75257]:         <nova:port uuid="109d45a8-89e1-43d8-9134-d29c37330e20">
Nov 14 02:22:59 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:22:59 user nova-compute[75257]:         </nova:port>
Nov 14 02:22:59 user nova-compute[75257]:       </nova:ports>
Nov 14 02:22:59 user nova-compute[75257]:     </nova:instance>
Nov 14 02:22:59 user nova-compute[75257]:   </metadata>
Nov 14 02:22:59 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:22:59 user nova-compute[75257]:     <system>
Nov 14 02:22:59 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:22:59 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:22:59 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:22:59 user nova-compute[75257]:       <entry name="serial">cbecb74e-b1af-404a-9fd6-050328413cac</entry>
Nov 14 02:22:59 user nova-compute[75257]:       <entry name="uuid">cbecb74e-b1af-404a-9fd6-050328413cac</entry>
Nov 14 02:22:59 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:22:59 user nova-compute[75257]:     </system>
Nov 14 02:22:59 user nova-compute[75257]:   </sysinfo>
Nov 14 02:22:59 user nova-compute[75257]:   <os>
Nov 14 02:22:59 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:22:59 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:22:59 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:22:59 user nova-compute[75257]:   </os>
Nov 14 02:22:59 user nova-compute[75257]:   <features>
Nov 14 02:22:59 user nova-compute[75257]:     <acpi/>
Nov 14 02:22:59 user nova-compute[75257]:     <apic/>
Nov 14 02:22:59 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:22:59 user nova-compute[75257]:   </features>
Nov 14 02:22:59 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:22:59 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:22:59 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:22:59 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:22:59 user nova-compute[75257]:   </clock>
Nov 14 02:22:59 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:22:59 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:22:59 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:22:59 user nova-compute[75257]:   </cpu>
Nov 14 02:22:59 user nova-compute[75257]:   <devices>
Nov 14 02:22:59 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:22:59 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:22:59 user nova-compute[75257]:       <source dev="/dev/sde"/>
Nov 14 02:22:59 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:22:59 user nova-compute[75257]:       <serial>515fd521-1fd4-4c68-aef5-5916661c86b0</serial>
Nov 14 02:22:59 user nova-compute[75257]:     </disk>
Nov 14 02:22:59 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:22:59 user nova-compute[75257]:       <mac address="fa:16:3e:bd:51:7f"/>
Nov 14 02:22:59 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:22:59 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:22:59 user nova-compute[75257]:       <target dev="tap109d45a8-89"/>
Nov 14 02:22:59 user nova-compute[75257]:     </interface>
Nov 14 02:22:59 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:22:59 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/console.log" append="off"/>
Nov 14 02:22:59 user nova-compute[75257]:     </serial>
Nov 14 02:22:59 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:22:59 user nova-compute[75257]:     <video>
Nov 14 02:22:59 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:22:59 user nova-compute[75257]:     </video>
Nov 14 02:22:59 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:22:59 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:22:59 user nova-compute[75257]:     </rng>
Nov 14 02:22:59 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:22:59 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:22:59 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:22:59 user nova-compute[75257]:     </memballoon>
Nov 14 02:22:59 user nova-compute[75257]:   </devices>
Nov 14 02:22:59 user nova-compute[75257]: </domain>
Nov 14 02:22:59 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-893670019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-893670019',id=39,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-xoef4f6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:22:48Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=cbecb74e-b1af-404a-9fd6-050328413cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:51:7f,bridge_name='br-int',has_traffic_filtering=True,id=109d45a8-89e1-43d8-9134-d29c37330e20,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109d45a8-89') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG os_vif [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:51:7f,bridge_name='br-int',has_traffic_filtering=True,id=109d45a8-89e1-43d8-9134-d29c37330e20,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109d45a8-89') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '057fc50f-028b-52ca-8664-8ba63900a599', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:22:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap109d45a8-89, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap109d45a8-89, col_values=(('qos', UUID('c164f1e1-be76-4081-90ed-2440e31df4b3')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap109d45a8-89, col_values=(('external_ids', {'iface-id': '109d45a8-89e1-43d8-9134-d29c37330e20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:51:7f', 'vm-uuid': 'cbecb74e-b1af-404a-9fd6-050328413cac'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:00 user nova-compute[75257]: INFO os_vif [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:51:7f,bridge_name='br-int',has_traffic_filtering=True,id=109d45a8-89e1-43d8-9134-d29c37330e20,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109d45a8-89')
Nov 14 02:23:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Instance destroyed successfully.
Nov 14 02:23:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Attempting rescue
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75257) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Instance directory exists: not creating {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 02:23:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Creating image(s)
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'trusted_certs' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No VIF found with MAC fa:16:3e:bd:51:7f, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue" returned: 0 in 0.051s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'migration_context' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.base [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<14f49370-77df-4e76-8e1d-4f89580315a4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Start _get_guest_xml network_info=[{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "vif_mac": "fa:16:3e:14:b4:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'resources' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.base [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<14f49370-77df-4e76-8e1d-4f89580315a4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'numa_topology' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.base [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<14f49370-77df-4e76-8e1d-4f89580315a4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:23:00 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:23:00 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'vcpu_model' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.base [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<14f49370-77df-4e76-8e1d-4f89580315a4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-174000204',display_name='tempest-ServerRescueNegativeTestJSON-server-174000204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-174000204',id=36,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsFmFIPhOCkXP+VUy2d+niU2Ks7ncJCtipI380Z6fBMTn/cwQN6BjKiVmK+YzwFjPQUOcxjnbmNi7hQtgs8AMfiaBh5aypsW4p/ucVfVfpy5S1RpOX+1GnlAPNw74qPJQ==',key_name='tempest-keypair-34722916',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-taocfvzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=14f49370-77df-4e76-8e1d-4f89580315a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "vif_mac": "fa:16:3e:14:b4:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "vif_mac": "fa:16:3e:14:b4:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=cbd77511-3da8-4b8f-bd1c-bb5e9992f811,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd77511-3d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'pci_devices' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.objects.base [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Object Instance<14f49370-77df-4e76-8e1d-4f89580315a4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:23:00 user nova-compute[75257]:   <uuid>14f49370-77df-4e76-8e1d-4f89580315a4</uuid>
Nov 14 02:23:00 user nova-compute[75257]:   <name>instance-00000024</name>
Nov 14 02:23:00 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:23:00 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:23:00 user nova-compute[75257]:   <metadata>
Nov 14 02:23:00 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:23:00 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:23:00 user nova-compute[75257]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-174000204</nova:name>
Nov 14 02:23:00 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:23:00</nova:creationTime>
Nov 14 02:23:00 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:23:00 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:23:00 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:23:00 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:23:00 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:23:00 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:23:00 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:23:00 user nova-compute[75257]:       <nova:owner>
Nov 14 02:23:00 user nova-compute[75257]:         <nova:user uuid="a5f8a4942cb54c9aa5377e6d2df1aa7b">tempest-ServerRescueNegativeTestJSON-66746497-project-member</nova:user>
Nov 14 02:23:00 user nova-compute[75257]:         <nova:project uuid="68ac9795cbe748fc8079de4bb8234cd3">tempest-ServerRescueNegativeTestJSON-66746497</nova:project>
Nov 14 02:23:00 user nova-compute[75257]:       </nova:owner>
Nov 14 02:23:00 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:23:00 user nova-compute[75257]:       <nova:ports>
Nov 14 02:23:00 user nova-compute[75257]:         <nova:port uuid="cbd77511-3da8-4b8f-bd1c-bb5e9992f811">
Nov 14 02:23:00 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 02:23:00 user nova-compute[75257]:         </nova:port>
Nov 14 02:23:00 user nova-compute[75257]:       </nova:ports>
Nov 14 02:23:00 user nova-compute[75257]:     </nova:instance>
Nov 14 02:23:00 user nova-compute[75257]:   </metadata>
Nov 14 02:23:00 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:23:00 user nova-compute[75257]:     <system>
Nov 14 02:23:00 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:23:00 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:23:00 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:23:00 user nova-compute[75257]:       <entry name="serial">14f49370-77df-4e76-8e1d-4f89580315a4</entry>
Nov 14 02:23:00 user nova-compute[75257]:       <entry name="uuid">14f49370-77df-4e76-8e1d-4f89580315a4</entry>
Nov 14 02:23:00 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:23:00 user nova-compute[75257]:     </system>
Nov 14 02:23:00 user nova-compute[75257]:   </sysinfo>
Nov 14 02:23:00 user nova-compute[75257]:   <os>
Nov 14 02:23:00 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:23:00 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:23:00 user nova-compute[75257]:   </os>
Nov 14 02:23:00 user nova-compute[75257]:   <features>
Nov 14 02:23:00 user nova-compute[75257]:     <acpi/>
Nov 14 02:23:00 user nova-compute[75257]:     <apic/>
Nov 14 02:23:00 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:23:00 user nova-compute[75257]:   </features>
Nov 14 02:23:00 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:23:00 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:23:00 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:23:00 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:23:00 user nova-compute[75257]:   </clock>
Nov 14 02:23:00 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:23:00 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:23:00 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:23:00 user nova-compute[75257]:   </cpu>
Nov 14 02:23:00 user nova-compute[75257]:   <devices>
Nov 14 02:23:00 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:23:00 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:23:00 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue"/>
Nov 14 02:23:00 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:23:00 user nova-compute[75257]:     </disk>
Nov 14 02:23:00 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:23:00 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:23:00 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk"/>
Nov 14 02:23:00 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:23:00 user nova-compute[75257]:     </disk>
Nov 14 02:23:00 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:23:00 user nova-compute[75257]:       <mac address="fa:16:3e:14:b4:b9"/>
Nov 14 02:23:00 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:23:00 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:23:00 user nova-compute[75257]:       <target dev="tapcbd77511-3d"/>
Nov 14 02:23:00 user nova-compute[75257]:     </interface>
Nov 14 02:23:00 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:23:00 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/console.log" append="off"/>
Nov 14 02:23:00 user nova-compute[75257]:     </serial>
Nov 14 02:23:00 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:23:00 user nova-compute[75257]:     <video>
Nov 14 02:23:00 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:23:00 user nova-compute[75257]:     </video>
Nov 14 02:23:00 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:23:00 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:23:00 user nova-compute[75257]:     </rng>
Nov 14 02:23:00 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:23:00 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:23:00 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:23:00 user nova-compute[75257]:     </memballoon>
Nov 14 02:23:00 user nova-compute[75257]:   </devices>
Nov 14 02:23:00 user nova-compute[75257]: </domain>
Nov 14 02:23:00 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:23:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Instance destroyed successfully.
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:23:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] No VIF found with MAC fa:16:3e:14:b4:b9, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:23:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:01 user nova-compute[75257]: WARNING nova.compute.manager [req-a4a5147e-c746-498b-8819-53b136bdbb52 req-80031c3e-b581-4bf5-a7c8-04ca539c7930 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state active and task_state rescuing.
Nov 14 02:23:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:02 user nova-compute[75257]: WARNING nova.compute.manager [req-a85446e5-b80e-4866-977c-82f89457f82d req-7bf25537-f1d6-4f89-a332-1e4263a4cad8 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state building and task_state spawning.
Nov 14 02:23:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:03 user nova-compute[75257]: WARNING nova.compute.manager [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state active and task_state rescuing.
Nov 14 02:23:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:03 user nova-compute[75257]: WARNING nova.compute.manager [req-8bf771e6-cef9-4d3d-82d5-aa5132a75a92 req-9108c1e2-2602-404f-a7bd-f0c96e7c503a service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state active and task_state rescuing.
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:23:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:04 user nova-compute[75257]: WARNING nova.compute.manager [req-2a8dba3f-e206-40ee-b50f-0d405f74505f req-47126f51-7cfb-451e-a0e7-cae63e13518d service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state building and task_state spawning.
Nov 14 02:23:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updating instance_info_cache with network_info: [{"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:04 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:23:05 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Instance spawned successfully.
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:05 user nova-compute[75257]: INFO nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:05 user nova-compute[75257]: INFO nova.compute.manager [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Took 18.26 seconds to build instance.
Nov 14 02:23:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-91e3ed8e-d30b-4763-b32e-6c45545b711d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "cbecb74e-b1af-404a-9fd6-050328413cac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.372s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fc52cfbf-7b25-491c-b674-23e1f8263458 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:05 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.268s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:23:10 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:23:10 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7503MB free_disk=24.985336303710938GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 14f49370-77df-4e76-8e1d-4f89580315a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 59e9702c-fd13-497e-abb9-bf85703fccea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance cbecb74e-b1af-404a-9fd6-050328413cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:23:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:23:11 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:23:11 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:23:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:23:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:23:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received event network-changed-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Refreshing instance network info cache due to event network-changed-a346a6b6-4287-489f-a426-f26a927d153c. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] Acquiring lock "refresh_cache-59e9702c-fd13-497e-abb9-bf85703fccea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] Acquired lock "refresh_cache-59e9702c-fd13-497e-abb9-bf85703fccea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG nova.network.neutron [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Refreshing network info cache for port a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG nova.objects.instance [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'flavor' on Instance uuid 59e9702c-fd13-497e-abb9-bf85703fccea {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Ignoring supplied device name: /dev/vdb
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:21 user nova-compute[75257]: INFO nova.compute.manager [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Attaching volume c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 to /dev/vdb
Nov 14 02:23:21 user nova-compute[75257]: DEBUG os_brick.utils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725e77a-d07e-445d-b5bf-f97260ebfc23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[de30f31c-b8de-4bf3-9ea0-137f5b4390fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b307c2d-ca00-475d-8be8-e2a376a0abf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d986c87-127e-4a22-9ddf-f113b0ec4df2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:23:21 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:23:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c49d143-bd63-45db-9e3f-5c796102d835]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG os_brick.utils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:23:21 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Updating existing volume attachment record: a0b2109e-1209-46e9-b9fc-c024acb7e66e {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:23:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Updated VIF entry in instance network info cache for port a346a6b6-4287-489f-a426-f26a927d153c. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:23:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Updating instance_info_cache with network_info: [{"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:23:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-cbd629c0-f745-4bd5-981a-491388b25398 req-0a86ca54-585e-4d55-861b-e0783a904f94 service nova] Releasing lock "refresh_cache-59e9702c-fd13-497e-abb9-bf85703fccea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:23:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:23:26 user nova-compute[75257]: INFO nova.compute.claims [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Claim successful on node user
Nov 14 02:23:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJBkDNZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:23:26 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:23:26 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:23:26 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bea2f5d-0948-4a22-9f7c-b79453e118ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:23:26 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda4b160-655b-4936-b7ca-28cd211c8813]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06] added
Nov 14 02:23:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a57499-1a94-4df7-8f62-895a4f4fcff6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[952bef15-2767-4054-8441-52d5ac80a8b6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJBkDNZr {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJBkDNZr" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84681c3-c305-473b-9ef2-eea17bb853c1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WJBkDNZr'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b248352c-7dea-44c3-a7ae-4dc72ce58731]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d30cac-e7c0-4b92-936f-58f830d4ae84]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8206e43-0f74-4d13-8302-0090e8358411]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06, portal: 172.16.0.220,3260]
Nov 14 02:23:26 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06, portal: 172.16.0.220,3260] successful.
Nov 14 02:23:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692831a-c6e1-405e-b674-ae950b8250bb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0848e595-ac91-4087-8102-e95f1cfcf8a4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)
Nov 14 02:23:26 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] HCTL ('38', '-', '-', 0) found on session 48 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ae2fc2-c416-431b-9a38-3255d0a7f7de]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Searching for a device in session 48 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJBkDNZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:23:26 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:23:26 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:23:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.policy [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a4b4a5d083c42ff8dffe1308cb04d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9aa4951950648f3a648099551dbbd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:23:27 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Creating image(s)
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "/opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "/opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk 1073741824" returned: 0 in 0.057s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26639613132366365', 'path': '/dev/sdg'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639613132366365', 'path': '/dev/sdg'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.objects.instance [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'flavor' on Instance uuid 59e9702c-fd13-497e-abb9-bf85703fccea {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:23:27 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:23:27 user nova-compute[75257]:   <source dev="/dev/sdg"/>
Nov 14 02:23:27 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:23:27 user nova-compute[75257]:   <serial>c4bec1fd-74cf-44e0-adf0-05dc7ded5e06</serial>
Nov 14 02:23:27 user nova-compute[75257]: </disk>
Nov 14 02:23:27 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Successfully created port: 1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Cannot resize image /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Ensure instance console log exists: /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] No VIF found with MAC fa:16:3e:83:d6:15, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-70e3e182-b2db-4b10-a7ce-6470be8dca20 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.602s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Successfully updated port: 1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "refresh_cache-4d2776db-0245-4ee0-ade9-8b87eaa44fae" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquired lock "refresh_cache-4d2776db-0245-4ee0-ade9-8b87eaa44fae" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received event network-changed-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Refreshing instance network info cache due to event network-changed-1fecad81-6dfa-495c-97d9-ebbdbb903a58. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] Acquiring lock "refresh_cache-4d2776db-0245-4ee0-ade9-8b87eaa44fae" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Updating instance_info_cache with network_info: [{"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Releasing lock "refresh_cache-4d2776db-0245-4ee0-ade9-8b87eaa44fae" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Instance network_info: |[{"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] Acquired lock "refresh_cache-4d2776db-0245-4ee0-ade9-8b87eaa44fae" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.network.neutron [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Refreshing network info cache for port 1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Start _get_guest_xml network_info=[{"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:23:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:23:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-765378703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-765378703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7653787',id=41,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNwTb2urTVLljSFUoM358TkxPplIcLrsExGy4PLF3r4Ehsu6aJYWb+8DHxXrLdPALDpXXE3Ne3ddgazJSGF/eYv9lJy+Pd3Zbm+a5WnOpVXLr8zFO/FMHhkfhV6vc8T9Q==',key_name='tempest-keypair-1580117513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9aa4951950648f3a648099551dbbd07',ramdisk_id='',reservation_id='r-fepoh7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-73995857',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a4b4a5d083c42ff8dffe1308cb04d75',uuid=4d2776db-0245-4ee0-ade9-8b87eaa44fae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Converting VIF {"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=1fecad81-6dfa-495c-97d9-ebbdbb903a58,network=Network(a3da3e1b-0b14-41dd-8801-7b05faf6a776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecad81-6d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d2776db-0245-4ee0-ade9-8b87eaa44fae {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:23:28 user nova-compute[75257]:   <uuid>4d2776db-0245-4ee0-ade9-8b87eaa44fae</uuid>
Nov 14 02:23:28 user nova-compute[75257]:   <name>instance-00000029</name>
Nov 14 02:23:28 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:23:28 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:23:28 user nova-compute[75257]:   <metadata>
Nov 14 02:23:28 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:23:28 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:23:28 user nova-compute[75257]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-765378703</nova:name>
Nov 14 02:23:28 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:23:28</nova:creationTime>
Nov 14 02:23:28 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:23:28 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:23:28 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:23:28 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:23:28 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:23:28 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:23:28 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:23:28 user nova-compute[75257]:       <nova:owner>
Nov 14 02:23:28 user nova-compute[75257]:         <nova:user uuid="3a4b4a5d083c42ff8dffe1308cb04d75">tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member</nova:user>
Nov 14 02:23:28 user nova-compute[75257]:         <nova:project uuid="f9aa4951950648f3a648099551dbbd07">tempest-TestServerVolumeAttachScenarioOldVersion-73995857</nova:project>
Nov 14 02:23:28 user nova-compute[75257]:       </nova:owner>
Nov 14 02:23:28 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:23:28 user nova-compute[75257]:       <nova:ports>
Nov 14 02:23:28 user nova-compute[75257]:         <nova:port uuid="1fecad81-6dfa-495c-97d9-ebbdbb903a58">
Nov 14 02:23:28 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 02:23:28 user nova-compute[75257]:         </nova:port>
Nov 14 02:23:28 user nova-compute[75257]:       </nova:ports>
Nov 14 02:23:28 user nova-compute[75257]:     </nova:instance>
Nov 14 02:23:28 user nova-compute[75257]:   </metadata>
Nov 14 02:23:28 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:23:28 user nova-compute[75257]:     <system>
Nov 14 02:23:28 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:23:28 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:23:28 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:23:28 user nova-compute[75257]:       <entry name="serial">4d2776db-0245-4ee0-ade9-8b87eaa44fae</entry>
Nov 14 02:23:28 user nova-compute[75257]:       <entry name="uuid">4d2776db-0245-4ee0-ade9-8b87eaa44fae</entry>
Nov 14 02:23:28 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:23:28 user nova-compute[75257]:     </system>
Nov 14 02:23:28 user nova-compute[75257]:   </sysinfo>
Nov 14 02:23:28 user nova-compute[75257]:   <os>
Nov 14 02:23:28 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:23:28 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:23:28 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:23:28 user nova-compute[75257]:   </os>
Nov 14 02:23:28 user nova-compute[75257]:   <features>
Nov 14 02:23:28 user nova-compute[75257]:     <acpi/>
Nov 14 02:23:28 user nova-compute[75257]:     <apic/>
Nov 14 02:23:28 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:23:28 user nova-compute[75257]:   </features>
Nov 14 02:23:28 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:23:28 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:23:28 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:23:28 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:23:28 user nova-compute[75257]:   </clock>
Nov 14 02:23:28 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:23:28 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:23:28 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:23:28 user nova-compute[75257]:   </cpu>
Nov 14 02:23:28 user nova-compute[75257]:   <devices>
Nov 14 02:23:28 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:23:28 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:23:28 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk"/>
Nov 14 02:23:28 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:23:28 user nova-compute[75257]:     </disk>
Nov 14 02:23:28 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:23:28 user nova-compute[75257]:       <mac address="fa:16:3e:fd:4e:1a"/>
Nov 14 02:23:28 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:23:28 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:23:28 user nova-compute[75257]:       <target dev="tap1fecad81-6d"/>
Nov 14 02:23:28 user nova-compute[75257]:     </interface>
Nov 14 02:23:28 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:23:28 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/console.log" append="off"/>
Nov 14 02:23:28 user nova-compute[75257]:     </serial>
Nov 14 02:23:28 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:23:28 user nova-compute[75257]:     <video>
Nov 14 02:23:28 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:23:28 user nova-compute[75257]:     </video>
Nov 14 02:23:28 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:23:28 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:23:28 user nova-compute[75257]:     </rng>
Nov 14 02:23:28 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:23:28 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:23:28 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:23:28 user nova-compute[75257]:     </memballoon>
Nov 14 02:23:28 user nova-compute[75257]:   </devices>
Nov 14 02:23:28 user nova-compute[75257]: </domain>
Nov 14 02:23:28 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-765378703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-765378703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7653787',id=41,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNwTb2urTVLljSFUoM358TkxPplIcLrsExGy4PLF3r4Ehsu6aJYWb+8DHxXrLdPALDpXXE3Ne3ddgazJSGF/eYv9lJy+Pd3Zbm+a5WnOpVXLr8zFO/FMHhkfhV6vc8T9Q==',key_name='tempest-keypair-1580117513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9aa4951950648f3a648099551dbbd07',ramdisk_id='',reservation_id='r-fepoh7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-73995857',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a4b4a5d083c42ff8dffe1308cb04d75',uuid=4d2776db-0245-4ee0-ade9-8b87eaa44fae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Converting VIF {"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=1fecad81-6dfa-495c-97d9-ebbdbb903a58,network=Network(a3da3e1b-0b14-41dd-8801-7b05faf6a776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecad81-6d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG os_vif [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=1fecad81-6dfa-495c-97d9-ebbdbb903a58,network=Network(a3da3e1b-0b14-41dd-8801-7b05faf6a776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecad81-6d') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '296ff68c-6d26-58df-88e2-d8f8c56bf014', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fecad81-6d, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fecad81-6d, col_values=(('qos', UUID('5c408ee0-f0be-4d8b-aa35-336b02be804d')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fecad81-6d, col_values=(('external_ids', {'iface-id': '1fecad81-6dfa-495c-97d9-ebbdbb903a58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:4e:1a', 'vm-uuid': '4d2776db-0245-4ee0-ade9-8b87eaa44fae'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:28 user nova-compute[75257]: INFO os_vif [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=1fecad81-6dfa-495c-97d9-ebbdbb903a58,network=Network(a3da3e1b-0b14-41dd-8801-7b05faf6a776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecad81-6d')
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:23:28 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] No VIF found with MAC fa:16:3e:fd:4e:1a, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:23:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Updated VIF entry in instance network info cache for port 1fecad81-6dfa-495c-97d9-ebbdbb903a58. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:23:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Updating instance_info_cache with network_info: [{"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:23:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d0035f15-1b1b-43a1-b16e-bdc8abad4f94 req-dadbb7ac-e9c7-41db-bedd-ed22e83dd702 service nova] Releasing lock "refresh_cache-4d2776db-0245-4ee0-ade9-8b87eaa44fae" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received event network-vif-plugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] No waiting events found dispatching network-vif-plugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:30 user nova-compute[75257]: WARNING nova.compute.manager [req-2865dad1-a846-430c-932a-eaa7b157cdd4 req-62bdcfd0-686e-488c-8894-6316f2e6153f service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received unexpected event network-vif-plugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance with vm_state building and task_state spawning.
Nov 14 02:23:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:23:32 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Instance spawned successfully.
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received event network-vif-plugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] No waiting events found dispatching network-vif-plugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:32 user nova-compute[75257]: WARNING nova.compute.manager [req-109ae164-8d09-4157-a655-935050de196a req-ec2eabbb-baf6-4733-aad0-c2d8ce466f46 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received unexpected event network-vif-plugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance with vm_state building and task_state spawning.
Nov 14 02:23:32 user nova-compute[75257]: INFO nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 14 02:23:32 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:23:32 user nova-compute[75257]: INFO nova.compute.manager [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Took 6.56 seconds to build instance.
Nov 14 02:23:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5604069a-d1d3-42e8-9ae6-9a7247bdee9c tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.677s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:33 user nova-compute[75257]: DEBUG nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:23:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:23:33 user nova-compute[75257]: INFO nova.compute.claims [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Claim successful on node user
Nov 14 02:23:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG nova.network.neutron [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:23:34 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:23:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG nova.policy [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:23:34 user nova-compute[75257]: INFO nova.virt.block_device [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Booting with volume 655abaca-9817-45dd-9bf8-480d3b8aeba8 at /dev/vda
Nov 14 02:23:34 user nova-compute[75257]: DEBUG os_brick.utils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[74efcc63-65e0-4cca-8c36-f1a9a2a64692]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa911430-d48e-4231-a571-8d82fa763127]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a952099-d366-459d-97ac-259589cc5947]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3069e742-cd4d-404f-8d9d-2f629191a778]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:23:34 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:23:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b728fe7-2040-44fc-929a-7f42e9d34e13]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG os_brick.utils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:23:34 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Updating existing volume attachment record: 644f32d8-66bf-4324-b51b-30bd7ccc9c99 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:23:35 user nova-compute[75257]: DEBUG nova.network.neutron [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Successfully created port: b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:23:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:35 user nova-compute[75257]: INFO nova.compute.manager [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Detaching volume c4bec1fd-74cf-44e0-adf0-05dc7ded5e06
Nov 14 02:23:35 user nova-compute[75257]: INFO nova.virt.block_device [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Attempting to driver detach volume c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 from mountpoint /dev/vdb
Nov 14 02:23:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Attempting to detach device vdb from instance 59e9702c-fd13-497e-abb9-bf85703fccea from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:23:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:23:35 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:23:35 user nova-compute[75257]:   <source dev="/dev/sdg"/>
Nov 14 02:23:35 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:23:35 user nova-compute[75257]:   <serial>c4bec1fd-74cf-44e0-adf0-05dc7ded5e06</serial>
Nov 14 02:23:35 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:23:35 user nova-compute[75257]: </disk>
Nov 14 02:23:35 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:23:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Successfully detached device vdb from instance 59e9702c-fd13-497e-abb9-bf85703fccea from the persistent domain config.
Nov 14 02:23:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59e9702c-fd13-497e-abb9-bf85703fccea from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:23:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:23:35 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:23:35 user nova-compute[75257]:   <source dev="/dev/sdg"/>
Nov 14 02:23:35 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:23:35 user nova-compute[75257]:   <serial>c4bec1fd-74cf-44e0-adf0-05dc7ded5e06</serial>
Nov 14 02:23:35 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:23:35 user nova-compute[75257]: </disk>
Nov 14 02:23:35 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:23:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.network.neutron [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Successfully updated port: b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "refresh_cache-29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquired lock "refresh_cache-29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.network.neutron [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received event network-changed-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Refreshing instance network info cache due to event network-changed-b8682a57-3293-47b6-9a6a-1149d39ceb33. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] Acquiring lock "refresh_cache-29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.network.neutron [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59e9702c-fd13-497e-abb9-bf85703fccea {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.network.neutron [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Updating instance_info_cache with network_info: [{"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Releasing lock "refresh_cache-29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Instance network_info: |[{"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] Acquired lock "refresh_cache-29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Refreshing network info cache for port b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Updated VIF entry in instance network info cache for port b8682a57-3293-47b6-9a6a-1149d39ceb33. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Updating instance_info_cache with network_info: [{"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:23:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-09b4d36b-4d39-48a2-b2b2-a829e5f04d1a req-6bc02d6c-70d8-4dbd-88a9-8b2104d85b77 service nova] Releasing lock "refresh_cache-29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:23:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:23:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Creating image(s)
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Ensure instance console log exists: /opt/stack/data/nova/instances/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Start _get_guest_xml network_info=[{"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '644f32d8-66bf-4324-b51b-30bd7ccc9c99', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frXTbdAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335', 'attached_at': '', 'detached_at': '', 'volume_id': '655abaca-9817-45dd-9bf8-480d3b8aeba8', 'serial': '655abaca-9817-45dd-9bf8-480d3b8aeba8'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:23:39 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:23:39 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frXTbdAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:23:39 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:23:39 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:23:39 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f9c6e-c34b-4e64-98a4-ee57fa4c34d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:23:39 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.101s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f9d2d-ff2e-4840-a41d-d5a4a0dacaf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8] added
Nov 14 02:23:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.085s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b71138-1da0-4b8d-bc26-9df4c2889f66]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.053s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95df612-2ce6-4e48-97a0-24f3bc4b74d8]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frXTbdAu {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frXTbdAu" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684d43b-ceab-42e9-b1c9-9ee6180c4f10]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'frXTbdAu'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c9d8cb-8a66-45be-97d1-f0f4145dba25]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c284719f-5d70-4ee3-b24d-cb3439857212]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3906746-dbd2-46c0-acc4-10299f9067e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260]
Nov 14 02:23:39 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260] successful.
Nov 14 02:23:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[15612cf3-2b16-4f09-baad-f4336c70e738]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[db425dbe-0f62-4a9c-888c-2d1692076920]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:23:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.520s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HCTL ('39', '-', '-', 0) found on session 49 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc66e7d3-23b1-4063-b4eb-117ee97c67ab]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching for a device in session 49 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:23:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frXTbdAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.559s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== connect_volume: return (1560ms) {'type': 'block', 'scsi_wwn': '26135353932656464', 'path': '/dev/sdh'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135353932656464', 'path': '/dev/sdh'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1850980078',display_name='tempest-TestVolumeBootPattern-server-1850980078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1850980078',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA==',key_name='tempest-TestVolumeBootPattern-1177175426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-teupum8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:23:35Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:31:58,bridge_name='br-int',has_traffic_filtering=True,id=b8682a57-3293-47b6-9a6a-1149d39ceb33,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8682a57-32') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'pci_devices' on Instance uuid 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:23:41 user nova-compute[75257]:   <uuid>29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335</uuid>
Nov 14 02:23:41 user nova-compute[75257]:   <name>instance-0000002a</name>
Nov 14 02:23:41 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:23:41 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:23:41 user nova-compute[75257]:   <metadata>
Nov 14 02:23:41 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:23:41 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:23:41 user nova-compute[75257]:       <nova:name>tempest-TestVolumeBootPattern-server-1850980078</nova:name>
Nov 14 02:23:41 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:23:39</nova:creationTime>
Nov 14 02:23:41 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:23:41 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:23:41 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:23:41 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:23:41 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:23:41 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:23:41 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:23:41 user nova-compute[75257]:       <nova:owner>
Nov 14 02:23:41 user nova-compute[75257]:         <nova:user uuid="61052c8663184644aa445e8b29a9d6ed">tempest-TestVolumeBootPattern-1633655156-project-member</nova:user>
Nov 14 02:23:41 user nova-compute[75257]:         <nova:project uuid="6e49d1cf0a1c457ab943ffd360f1c3da">tempest-TestVolumeBootPattern-1633655156</nova:project>
Nov 14 02:23:41 user nova-compute[75257]:       </nova:owner>
Nov 14 02:23:41 user nova-compute[75257]:       <nova:ports>
Nov 14 02:23:41 user nova-compute[75257]:         <nova:port uuid="b8682a57-3293-47b6-9a6a-1149d39ceb33">
Nov 14 02:23:41 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 02:23:41 user nova-compute[75257]:         </nova:port>
Nov 14 02:23:41 user nova-compute[75257]:       </nova:ports>
Nov 14 02:23:41 user nova-compute[75257]:     </nova:instance>
Nov 14 02:23:41 user nova-compute[75257]:   </metadata>
Nov 14 02:23:41 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:23:41 user nova-compute[75257]:     <system>
Nov 14 02:23:41 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:23:41 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:23:41 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:23:41 user nova-compute[75257]:       <entry name="serial">29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335</entry>
Nov 14 02:23:41 user nova-compute[75257]:       <entry name="uuid">29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335</entry>
Nov 14 02:23:41 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:23:41 user nova-compute[75257]:     </system>
Nov 14 02:23:41 user nova-compute[75257]:   </sysinfo>
Nov 14 02:23:41 user nova-compute[75257]:   <os>
Nov 14 02:23:41 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:23:41 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:23:41 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:23:41 user nova-compute[75257]:   </os>
Nov 14 02:23:41 user nova-compute[75257]:   <features>
Nov 14 02:23:41 user nova-compute[75257]:     <acpi/>
Nov 14 02:23:41 user nova-compute[75257]:     <apic/>
Nov 14 02:23:41 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:23:41 user nova-compute[75257]:   </features>
Nov 14 02:23:41 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:23:41 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:23:41 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:23:41 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:23:41 user nova-compute[75257]:   </clock>
Nov 14 02:23:41 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:23:41 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:23:41 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:23:41 user nova-compute[75257]:   </cpu>
Nov 14 02:23:41 user nova-compute[75257]:   <devices>
Nov 14 02:23:41 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:23:41 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:23:41 user nova-compute[75257]:       <source dev="/dev/sdh"/>
Nov 14 02:23:41 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:23:41 user nova-compute[75257]:       <serial>655abaca-9817-45dd-9bf8-480d3b8aeba8</serial>
Nov 14 02:23:41 user nova-compute[75257]:     </disk>
Nov 14 02:23:41 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:23:41 user nova-compute[75257]:       <mac address="fa:16:3e:dc:31:58"/>
Nov 14 02:23:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:23:41 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:23:41 user nova-compute[75257]:       <target dev="tapb8682a57-32"/>
Nov 14 02:23:41 user nova-compute[75257]:     </interface>
Nov 14 02:23:41 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:23:41 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335/console.log" append="off"/>
Nov 14 02:23:41 user nova-compute[75257]:     </serial>
Nov 14 02:23:41 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:23:41 user nova-compute[75257]:     <video>
Nov 14 02:23:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:23:41 user nova-compute[75257]:     </video>
Nov 14 02:23:41 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:23:41 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:23:41 user nova-compute[75257]:     </rng>
Nov 14 02:23:41 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:23:41 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:23:41 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:23:41 user nova-compute[75257]:     </memballoon>
Nov 14 02:23:41 user nova-compute[75257]:   </devices>
Nov 14 02:23:41 user nova-compute[75257]: </domain>
Nov 14 02:23:41 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1850980078',display_name='tempest-TestVolumeBootPattern-server-1850980078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1850980078',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA==',key_name='tempest-TestVolumeBootPattern-1177175426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-teupum8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:23:35Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:31:58,bridge_name='br-int',has_traffic_filtering=True,id=b8682a57-3293-47b6-9a6a-1149d39ceb33,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8682a57-32') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG os_vif [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:31:58,bridge_name='br-int',has_traffic_filtering=True,id=b8682a57-3293-47b6-9a6a-1149d39ceb33,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8682a57-32') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0389c83-9c2e-5989-b8f0-e7ddc757e368', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8682a57-32, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8682a57-32, col_values=(('qos', UUID('c8f7c526-2208-460b-9adf-5f843b302824')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8682a57-32, col_values=(('external_ids', {'iface-id': 'b8682a57-3293-47b6-9a6a-1149d39ceb33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:31:58', 'vm-uuid': '29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:41 user nova-compute[75257]: INFO os_vif [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:31:58,bridge_name='br-int',has_traffic_filtering=True,id=b8682a57-3293-47b6-9a6a-1149d39ceb33,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8682a57-32')
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:23:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No VIF found with MAC fa:16:3e:dc:31:58, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:23:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received event network-vif-plugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] Acquiring lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] No waiting events found dispatching network-vif-plugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:42 user nova-compute[75257]: WARNING nova.compute.manager [req-711121a5-dfeb-457d-9c54-f90a4c736ece req-c1e56c52-26e7-4ae6-90fa-aa5ad1ac60eb service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received unexpected event network-vif-plugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance with vm_state building and task_state spawning.
Nov 14 02:23:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:23:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Instance spawned successfully.
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received event network-vif-plugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] Acquiring lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] No waiting events found dispatching network-vif-plugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:44 user nova-compute[75257]: WARNING nova.compute.manager [req-a34de2d0-e9fc-44f0-8a02-999f58d3b685 req-93881ccd-b9af-47bb-94c9-8eed6bb9a085 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received unexpected event network-vif-plugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance with vm_state building and task_state spawning.
Nov 14 02:23:44 user nova-compute[75257]: INFO nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 14 02:23:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:23:44 user nova-compute[75257]: INFO nova.compute.manager [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Took 11.10 seconds to build instance.
Nov 14 02:23:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-57adc203-b273-41d7-ac1b-472940250d5e tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.232s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:56 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 59e9702c-fd13-497e-abb9-bf85703fccea is timed out.
Nov 14 02:23:56 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Successfully detached device vdb from instance 59e9702c-fd13-497e-abb9-bf85703fccea from the live domain config.
Nov 14 02:23:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJBkDNZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:23:56 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1a76d3-2278-4d3d-aa30-36330a0c2f16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:23:56 user nova-compute[75257]: No targets found.
Nov 14 02:23:56 user nova-compute[75257]: iSNS:
Nov 14 02:23:56 user nova-compute[75257]: No targets found.
Nov 14 02:23:56 user nova-compute[75257]: STATIC:
Nov 14 02:23:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4
Nov 14 02:23:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:23:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64
Nov 14 02:23:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06
Nov 14 02:23:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:23:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:23:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:56 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:23:56 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:56 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:56 user nova-compute[75257]: FIRMWARE:
Nov 14 02:23:56 user nova-compute[75257]: No targets found.
Nov 14 02:23:56 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:23:56 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:23:56 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af542739-6a83-452a-9d2a-1805b689b36f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa1f19c-841e-4790-a4ab-cfadf1798398]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:23:56 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a435edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06'): ({'sdg'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Removing single pathed devices sdg {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e4e49b-5aa1-46c1-a694-9771735645cf]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[372046d6-d9f1-45ec-941d-c76b6b074a37]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Flushing IO for device /dev/sdg {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff7e11-5bb1-470a-97b6-a8da6dd32b7c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa908b-38be-4938-8692-2c9b3345a8fa]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] SCSI volumes sdg have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f761964-5cfa-410b-8ed7-07c4f5ac044d]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[149d515c-5041-4010-85aa-a6fd4f109d1a]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06, portal: 172.16.0.220,3260]
Nov 14 02:23:56 user nova-compute[75257]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06, portal: 172.16.0.220,3260] successful.
Nov 14 02:23:56 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adfd6b7-c3de-4a20-bbdd-4f3e27804ff1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] <== disconnect_volume: return (309ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:23:56 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG nova.objects.instance [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'flavor' on Instance uuid 59e9702c-fd13-497e-abb9-bf85703fccea {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c52292d9-8331-4048-82b3-5accecb6ac81 tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.582s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:57 user nova-compute[75257]: INFO nova.compute.manager [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Terminating instance
Nov 14 02:23:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received event network-vif-unplugged-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] No waiting events found dispatching network-vif-unplugged-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-7a8f663c-6410-4070-8de0-1e1782963d56 req-f79cb1c9-75e9-44b9-981c-053bd54d9352 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received event network-vif-unplugged-a346a6b6-4287-489f-a426-f26a927d153c for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:23:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Instance destroyed successfully.
Nov 14 02:23:58 user nova-compute[75257]: DEBUG nova.objects.instance [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lazy-loading 'resources' on Instance uuid 59e9702c-fd13-497e-abb9-bf85703fccea {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1137021199',display_name='tempest-VolumesSnapshotTestJSON-instance-1137021199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1137021199',id=37,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4yKgyDK23ewe450iUs1rZwM21NYHFAcoK312eJ7UUkzY/DPknEhw1XJrr03KJO7BTArPrFwXojLXC/Yubfbl/x+1OBc0kBiaNaT0KVcBwhR2dL31ZDEOK1fyYWhqY5ww==',key_name='tempest-keypair-817367158',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:21:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdd36fad5dd04e79a672f69b7e100ae5',ramdisk_id='',reservation_id='r-lmrz0403',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-408710193',owner_user_name='tempest-VolumesSnapshotTestJSON-408710193-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:21:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0729cfec73f44f4eafb49d51f9ce01e2',uuid=59e9702c-fd13-497e-abb9-bf85703fccea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converting VIF {"id": "a346a6b6-4287-489f-a426-f26a927d153c", "address": "fa:16:3e:83:d6:15", "network": {"id": "dfcd5f09-6f3c-4ea6-b88a-76233441a7c2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-330809815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdd36fad5dd04e79a672f69b7e100ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa346a6b6-42", "ovs_interfaceid": "a346a6b6-4287-489f-a426-f26a927d153c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=a346a6b6-4287-489f-a426-f26a927d153c,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa346a6b6-42') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_vif [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=a346a6b6-4287-489f-a426-f26a927d153c,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa346a6b6-42') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa346a6b6-42, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90989b3e-35f9-4436-95d1-46c0a0ab5370) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:58 user nova-compute[75257]: INFO os_vif [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:d6:15,bridge_name='br-int',has_traffic_filtering=True,id=a346a6b6-4287-489f-a426-f26a927d153c,network=Network(dfcd5f09-6f3c-4ea6-b88a-76233441a7c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa346a6b6-42')
Nov 14 02:23:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJBkDNZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:23:58 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[954821c7-f9ff-4868-a80e-d780199f63a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:23:58 user nova-compute[75257]: No targets found.
Nov 14 02:23:58 user nova-compute[75257]: iSNS:
Nov 14 02:23:58 user nova-compute[75257]: No targets found.
Nov 14 02:23:58 user nova-compute[75257]: STATIC:
Nov 14 02:23:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4
Nov 14 02:23:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:23:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64
Nov 14 02:23:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:23:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:23:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:58 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:23:58 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:58 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:58 user nova-compute[75257]: FIRMWARE:
Nov 14 02:23:58 user nova-compute[75257]: No targets found.
Nov 14 02:23:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:23:58 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:23:58 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4bec1fd-74cf-44e0-adf0-05dc7ded5e06', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f5265-e282-4f2a-b0f2-66e1ec02d837]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6a356-d345-47b2-aab3-69b40ff8f7a9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:23:58 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a4375ab0>, {}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Disconnecting from: [] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] <== disconnect_volume: return (85ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:23:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Deleting instance files /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea_del
Nov 14 02:23:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Deletion of /opt/stack/data/nova/instances/59e9702c-fd13-497e-abb9-bf85703fccea_del complete
Nov 14 02:23:58 user nova-compute[75257]: INFO nova.compute.manager [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:58 user nova-compute[75257]: INFO nova.compute.manager [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Terminating instance
Nov 14 02:23:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:23:59 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Took 0.77 seconds to deallocate network for instance.
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received event network-vif-deleted-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:59 user nova-compute[75257]: INFO nova.compute.manager [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Neutron deleted interface a346a6b6-4287-489f-a426-f26a927d153c; detaching it from the instance and deleting it from the info cache
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:23:59 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Instance destroyed successfully.
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.objects.instance [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'resources' on Instance uuid 90d8b16a-a1f1-4625-a715-e5e8bd87d66b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-28e43667-bccf-4f99-9b53-321f4e79a564 req-9d58a63d-795e-415b-9d5e-9128edeadb32 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Detach interface failed, port_id=a346a6b6-4287-489f-a426-f26a927d153c, reason: Instance 59e9702c-fd13-497e-abb9-bf85703fccea could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:23:59 user nova-compute[75257]: WARNING nova.volume.cinder [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Attachment a0b2109e-1209-46e9-b9fc-c024acb7e66e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a0b2109e-1209-46e9-b9fc-c024acb7e66e. (HTTP 404) (Request-ID: req-f8eedb5d-d0c8-4399-a9dc-269e210bca64)
Nov 14 02:23:59 user nova-compute[75257]: INFO nova.compute.manager [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Took 0.04 seconds to detach 1 volumes for instance.
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1977700667',display_name='tempest-ServerActionsTestOtherA-server-1977700667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1977700667',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww==',key_name='tempest-keypair-1627475945',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-jhpchxnl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=90d8b16a-a1f1-4625-a715-e5e8bd87d66b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "36f42e8b-2ba5-49e9-9966-67431aed797f", "address": "fa:16:3e:a8:b7:c9", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f42e8b-2b", "ovs_interfaceid": "36f42e8b-2ba5-49e9-9966-67431aed797f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_vif [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36f42e8b-2b, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56016099-e627-4801-8495-ea954af102d9) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:23:59 user nova-compute[75257]: INFO os_vif [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b7:c9,bridge_name='br-int',has_traffic_filtering=True,id=36f42e8b-2ba5-49e9-9966-67431aed797f,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f42e8b-2b')
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcdzUPrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:23:59 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[be540494-c461-4261-aac4-ae2822895d43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:23:59 user nova-compute[75257]: No targets found.
Nov 14 02:23:59 user nova-compute[75257]: iSNS:
Nov 14 02:23:59 user nova-compute[75257]: No targets found.
Nov 14 02:23:59 user nova-compute[75257]: STATIC:
Nov 14 02:23:59 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4
Nov 14 02:23:59 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:59 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:59 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83
Nov 14 02:23:59 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:59 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:59 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64
Nov 14 02:23:59 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:59 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:59 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:23:59 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:59 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:59 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:23:59 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:59 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:59 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:23:59 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:23:59 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:23:59 user nova-compute[75257]: FIRMWARE:
Nov 14 02:23:59 user nova-compute[75257]: No targets found.
Nov 14 02:23:59 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:23:59 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:23:59 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[96101964-3a8a-490c-9cfd-cd4ab8d2cc02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b84514-2064-4b79-821d-fe7ae679e761]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:23:59 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a453f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83'): ({'sdf'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Removing single pathed devices sdf {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[758ce77d-7a18-40a7-85ff-8b205b9875f9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[22331c3e-57d6-4f5b-9cba-fad55319359d]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Flushing IO for device /dev/sdf {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[037f0383-b642-43c3-aa37-5facb782d5af]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[15144ba6-0838-4f56-8690-5216b70d9d62]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[302ad35a-e69c-4165-a03f-1d02c91eb26c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1976ad58-6164-4556-89e7-f91d4fc81574]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260]
Nov 14 02:23:59 user nova-compute[75257]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83, portal: 172.16.0.220,3260] successful.
Nov 14 02:23:59 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe732f2-6802-4277-9e26-6ee51b70df83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4992447-b560-4191-a207-7f8ee158c9f0]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] <== disconnect_volume: return (350ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:23:59 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Deleting instance files /opt/stack/data/nova/instances/90d8b16a-a1f1-4625-a715-e5e8bd87d66b_del
Nov 14 02:23:59 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Deletion of /opt/stack/data/nova/instances/90d8b16a-a1f1-4625-a715-e5e8bd87d66b_del complete
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:23:59 user nova-compute[75257]: INFO nova.compute.manager [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:23:59 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Deleted allocations for instance 59e9702c-fd13-497e-abb9-bf85703fccea
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received event network-vif-plugged-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Acquiring lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Lock "59e9702c-fd13-497e-abb9-bf85703fccea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] No waiting events found dispatching network-vif-plugged-a346a6b6-4287-489f-a426-f26a927d153c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:59 user nova-compute[75257]: WARNING nova.compute.manager [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] [instance: 59e9702c-fd13-497e-abb9-bf85703fccea] Received unexpected event network-vif-plugged-a346a6b6-4287-489f-a426-f26a927d153c for instance with vm_state deleted and task_state None.
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-unplugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] No waiting events found dispatching network-vif-unplugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-unplugged-36f42e8b-2ba5-49e9-9966-67431aed797f for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Acquiring lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:23:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] No waiting events found dispatching network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:23:59 user nova-compute[75257]: WARNING nova.compute.manager [req-c5913c9e-c60a-4ff5-8aa8-98ea623800a7 req-81645bd8-086b-4061-8494-a8a13fb41782 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received unexpected event network-vif-plugged-36f42e8b-2ba5-49e9-9966-67431aed797f for instance with vm_state active and task_state deleting.
Nov 14 02:23:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-edb51b6f-f69d-48ee-a862-722c4ec0ae2b tempest-VolumesSnapshotTestJSON-408710193 tempest-VolumesSnapshotTestJSON-408710193-project-member] Lock "59e9702c-fd13-497e-abb9-bf85703fccea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.443s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:00 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:00 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Took 1.02 seconds to deallocate network for instance.
Nov 14 02:24:00 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:24:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-5bf5371d-d16e-4f1f-9e6f-f0876b030efd req-b9c07113-5e13-4a94-820d-02e6bdcd1c16 service nova] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Received event network-vif-deleted-36f42e8b-2ba5-49e9-9966-67431aed797f {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:01 user nova-compute[75257]: INFO nova.compute.manager [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 02:24:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 90d8b16a-a1f1-4625-a715-e5e8bd87d66b] Deleting volume: bfe732f2-6802-4277-9e26-6ee51b70df83 {{(pid=75257) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 02:24:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:01 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:24:01 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:24:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:01 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Deleted allocations for instance 90d8b16a-a1f1-4625-a715-e5e8bd87d66b
Nov 14 02:24:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-46f0cb9a-abfa-4389-bcbd-70b87be9b4d6 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "90d8b16a-a1f1-4625-a715-e5e8bd87d66b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.703s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:24:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:24:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:24:04 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:24:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:24:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:24:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:24:05 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updating instance_info_cache with network_info: [{"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:24:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:24:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:24:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:24:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:24:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:24:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:06 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:24:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:24:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:24:11 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:24:11 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7011MB free_disk=24.941852569580078GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 14f49370-77df-4e76-8e1d-4f89580315a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance cbecb74e-b1af-404a-9fd6-050328413cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance dcca61ed-4b5a-4966-8584-bde4f1954eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:24:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:24:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:24:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:24:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-changed-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Refreshing instance network info cache due to event network-changed-cd7b2500-ad09-43fc-ad92-8338dc32fcbe. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:24:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] Acquiring lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:24:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] Acquired lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:24:32 user nova-compute[75257]: DEBUG nova.network.neutron [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Refreshing network info cache for port cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:24:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:32 user nova-compute[75257]: DEBUG nova.network.neutron [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updated VIF entry in instance network info cache for port cd7b2500-ad09-43fc-ad92-8338dc32fcbe. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:24:32 user nova-compute[75257]: DEBUG nova.network.neutron [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating instance_info_cache with network_info: [{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-07a57226-ef15-4a39-846c-2c8b0d66515d req-9b132047-9b49-405e-9b3f-5765d0493869 service nova] Releasing lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:24:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:34 user nova-compute[75257]: INFO nova.compute.manager [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Shelving
Nov 14 02:24:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-unplugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] No waiting events found dispatching network-vif-unplugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:35 user nova-compute[75257]: WARNING nova.compute.manager [req-708fbaba-c143-47c1-8d31-1adf0d9e65ed req-d1d9d70a-b6c6-41c8-a223-ed09391e17fd service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received unexpected event network-vif-unplugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance with vm_state active and task_state shelving.
Nov 14 02:24:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance destroyed successfully.
Nov 14 02:24:35 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Beginning cold snapshot process
Nov 14 02:24:35 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:24:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk /opt/stack/data/nova/instances/snapshots/tmpgoolkxpn/625326fa573e43fbb2ab215c41d99b32 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk /opt/stack/data/nova/instances/snapshots/tmpgoolkxpn/625326fa573e43fbb2ab215c41d99b32" returned: 0 in 0.672s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Snapshot extracted, beginning image upload
Nov 14 02:24:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] No waiting events found dispatching network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:37 user nova-compute[75257]: WARNING nova.compute.manager [req-9dfe1da7-29cb-4641-903a-ed8fdce5b49f req-4879db73-1605-4f71-92df-b820cce65f65 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received unexpected event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 02:24:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:38 user nova-compute[75257]: INFO nova.compute.manager [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Rescuing
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquired lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received event network-changed-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Refreshing instance network info cache due to event network-changed-6e087160-8d8f-4fce-8f06-559aa76e24ad. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] Acquiring lock "refresh_cache-dcca61ed-4b5a-4966-8584-bde4f1954eb3" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] Acquired lock "refresh_cache-dcca61ed-4b5a-4966-8584-bde4f1954eb3" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.network.neutron [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Refreshing network info cache for port 6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.network.neutron [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Updating instance_info_cache with network_info: [{"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Releasing lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.network.neutron [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Updated VIF entry in instance network info cache for port 6e087160-8d8f-4fce-8f06-559aa76e24ad. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.network.neutron [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Updating instance_info_cache with network_info: [{"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:38 user nova-compute[75257]: INFO nova.compute.manager [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Terminating instance
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.compute.manager [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bf7920cc-160f-44a7-8555-72b5343749c9 req-93d12f2a-7926-4d39-b50f-142f78489686 service nova] Releasing lock "refresh_cache-dcca61ed-4b5a-4966-8584-bde4f1954eb3" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Snapshot image upload complete
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.compute.manager [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-unplugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-unplugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:38 user nova-compute[75257]: WARNING nova.compute.manager [req-2d2b1d2b-1d01-48ed-9080-b30f948c1c7c req-4436fda7-64d4-4c6e-a94c-295502c0f492 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-unplugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state active and task_state rescuing.
Nov 14 02:24:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:39 user nova-compute[75257]: INFO nova.compute.manager [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Shelve offloading
Nov 14 02:24:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance destroyed successfully.
Nov 14 02:24:39 user nova-compute[75257]: DEBUG nova.compute.manager [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquired lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG nova.network.neutron [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Instance destroyed successfully.
Nov 14 02:24:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Attempting a stable device rescue
Nov 14 02:24:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75257) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Instance directory exists: not creating {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 02:24:39 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Creating image(s)
Nov 14 02:24:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "/opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "/opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'trusted_certs' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:39 user nova-compute[75257]: DEBUG nova.network.neutron [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating instance_info_cache with network_info: [{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Releasing lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:24:40 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Instance destroyed successfully.
Nov 14 02:24:40 user nova-compute[75257]: DEBUG nova.objects.instance [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'resources' on Instance uuid dcca61ed-4b5a-4966-8584-bde4f1954eb3 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1080161757',display_name='tempest-AttachVolumeNegativeTest-server-1080161757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1080161757',id=40,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyP+oGtxHij1jDu5knyUXkkhCO10Kr3wgx1E+1ZMdIoetrpAJi7/mDioMn2T01vMWyRKhkVoaQnkrepY+1+EoZehy+AI67In10R7oubX4qC0uKjONiArFcfumG/sW8TlA==',key_name='tempest-keypair-534394893',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-qj2paako',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:22:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=dcca61ed-4b5a-4966-8584-bde4f1954eb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "address": "fa:16:3e:eb:16:2d", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e087160-8d", "ovs_interfaceid": "6e087160-8d8f-4fce-8f06-559aa76e24ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e087160-8d8f-4fce-8f06-559aa76e24ad,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e087160-8d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG os_vif [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e087160-8d8f-4fce-8f06-559aa76e24ad,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e087160-8d') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e087160-8d, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c44bd350-9f65-4d60-ad80-da670a44d370) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:40 user nova-compute[75257]: INFO os_vif [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:2d,bridge_name='br-int',has_traffic_filtering=True,id=6e087160-8d8f-4fce-8f06-559aa76e24ad,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e087160-8d')
Nov 14 02:24:40 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Deleting instance files /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3_del
Nov 14 02:24:40 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Deletion of /opt/stack/data/nova/instances/dcca61ed-4b5a-4966-8584-bde4f1954eb3_del complete
Nov 14 02:24:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG nova.virt.images [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] c6ac23a8-2afc-4e56-9495-c0c69cee6fd1 was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8.part /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:40 user nova-compute[75257]: INFO nova.compute.manager [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Took 1.82 seconds to destroy the instance on the hypervisor.
Nov 14 02:24:40 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:24:40 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:41 user nova-compute[75257]: WARNING nova.compute.manager [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state active and task_state rescuing.
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received event network-vif-unplugged-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Acquiring lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] No waiting events found dispatching network-vif-unplugged-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received event network-vif-unplugged-6e087160-8d8f-4fce-8f06-559aa76e24ad for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received event network-vif-plugged-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Acquiring lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] No waiting events found dispatching network-vif-plugged-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:41 user nova-compute[75257]: WARNING nova.compute.manager [req-12923c32-97ca-4174-8135-5d2d94c9c8bf req-54f70c4e-a77b-49ac-9121-e7c6a5afcac5 service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received unexpected event network-vif-plugged-6e087160-8d8f-4fce-8f06-559aa76e24ad for instance with vm_state active and task_state deleting.
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8.part /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8.converted" returned: 0 in 0.342s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.789s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-changed-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Refreshing instance network info cache due to event network-changed-cd7b2500-ad09-43fc-ad92-8338dc32fcbe. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] Acquiring lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] Acquired lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.network.neutron [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Refreshing network info cache for port cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:24:41 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance destroyed successfully.
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'resources' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432527132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432527132',id=38,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDtiB1Q/29INzS1Awe+SrgWEvNOe4OsR9c2+ytcV4I9qNI9t4UTFZ3vYkj4sjWDTElkVGfSPjrpMOIeYBmbQit22H7RXOnJXqzHe8TWNNfea+Locbv+beA3JPiwlKqB5A==',key_name='tempest-keypair-1542235845',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-xuuad11y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member',shelved_at='2023-11-14T02:24:38.957102',shelved_host='user',shelved_image_id='40cb1e44-becc-4426-82e6-67b6680c8e88'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:24:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=f3c72a5a-0bce-4ebe-b2da-61f7f08155cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_vif [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd7b2500-ad, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc00f5b7-a236-4144-897c-6d7e6658eda5) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:41 user nova-compute[75257]: INFO os_vif [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad')
Nov 14 02:24:41 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Deleting instance files /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc_del
Nov 14 02:24:41 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Deletion of /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc_del complete
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8 --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8,backing_fmt=raw /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8,backing_fmt=raw /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue" returned: 0 in 0.047s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'migration_context' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<cbecb74e-b1af-404a-9fd6-050328413cac> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Start _get_guest_xml network_info=[{"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "vif_mac": "fa:16:3e:bd:51:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c6ac23a8-2afc-4e56-9495-c0c69cee6fd1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8ee8040e-22ef-43ef-aa8e-f29a2de5a867', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFpxJTIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'cbecb74e-b1af-404a-9fd6-050328413cac', 'attached_at': '', 'detached_at': '', 'volume_id': '515fd521-1fd4-4c68-aef5-5916661c86b0', 'serial': '515fd521-1fd4-4c68-aef5-5916661c86b0'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'resources' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<cbecb74e-b1af-404a-9fd6-050328413cac> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'numa_topology' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<cbecb74e-b1af-404a-9fd6-050328413cac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:24:41 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:24:41 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:24:41 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Deleted allocations for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'vcpu_model' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<cbecb74e-b1af-404a-9fd6-050328413cac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFpxJTIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:24:41 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:24:41 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:24:41 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'numa_topology' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccaaf59-e896-496c-8f27-4d41cc8ce04c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cFpxJTIs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 02:24:41 user nova-compute[75257]: node.name = iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:24:41 user nova-compute[75257]: node.tpgt = -1
Nov 14 02:24:41 user nova-compute[75257]: node.startup = automatic
Nov 14 02:24:41 user nova-compute[75257]: node.leading_login = No
Nov 14 02:24:41 user nova-compute[75257]: iface.iscsi_ifacename = default
Nov 14 02:24:41 user nova-compute[75257]: iface.net_ifacename = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.ipaddress = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.prefix_len = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.hwaddress = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.transport_name = tcp
Nov 14 02:24:41 user nova-compute[75257]: iface.initiatorname = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.state = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.vlan_id = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.vlan_priority = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.vlan_state = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.iface_num = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.mtu = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.port = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.bootproto = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.subnet_mask = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.gateway = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.dhcp_alt_client_id = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.dhcp_dns = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.dhcp_learn_iqn = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.dhcp_vendor_id_state = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.dhcp_vendor_id = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.dhcp_slp_da = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.fragmentation = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.gratuitous_arp = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.incoming_forwarding = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.tos_state = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.tos = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.ttl = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.delayed_ack = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.tcp_nagle = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.tcp_wsf_state = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.tcp_wsf = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.tcp_timer_scale = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.tcp_timestamp = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.redirect = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.def_task_mgmt_timeout = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.header_digest = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.data_digest = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.immediate_data = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.initial_r2t = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.data_seq_inorder = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.data_pdu_inorder = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.erl = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.max_receive_data_len = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.first_burst_len = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.max_outstanding_r2t = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.max_burst_len = 0
Nov 14 02:24:41 user nova-compute[75257]: iface.chap_auth = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.bidi_chap = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.strict_login_compliance = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.discovery_auth = <empty>
Nov 14 02:24:41 user nova-compute[75257]: iface.discovery_logout = <empty>
Nov 14 02:24:41 user nova-compute[75257]: node.discovery_address = <empty>
Nov 14 02:24:41 user nova-compute[75257]: node.discovery_port = 0
Nov 14 02:24:41 user nova-compute[75257]: node.discovery_type = static
Nov 14 02:24:41 user nova-compute[75257]: node.session.initial_cmdsn = 0
Nov 14 02:24:41 user nova-compute[75257]: node.session.initial_login_retry_max = 8
Nov 14 02:24:41 user nova-compute[75257]: node.session.xmit_thread_priority = -20
Nov 14 02:24:41 user nova-compute[75257]: node.session.cmds_max = 128
Nov 14 02:24:41 user nova-compute[75257]: node.session.queue_depth = 32
Nov 14 02:24:41 user nova-compute[75257]: node.session.nr_sessions = 1
Nov 14 02:24:41 user nova-compute[75257]: node.session.auth.authmethod = CHAP
Nov 14 02:24:41 user nova-compute[75257]: node.session.auth.username = cFpxJTIs
Nov 14 02:24:41 user nova-compute[75257]: node.session.auth.password = ***
Nov 14 02:24:41 user nova-compute[75257]: node.session.auth.username_in = <empty>
Nov 14 02:24:41 user nova-compute[75257]: node.session.auth.password_in = <empty>
Nov 14 02:24:41 user nova-compute[75257]: node.session.auth.chap_algs = MD5
Nov 14 02:24:41 user nova-compute[75257]: node.session.timeo.replacement_timeout = 120
Nov 14 02:24:41 user nova-compute[75257]: node.session.err_timeo.abort_timeout = 15
Nov 14 02:24:41 user nova-compute[75257]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 02:24:41 user nova-compute[75257]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 02:24:41 user nova-compute[75257]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.FastAbort = Yes
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.InitialR2T = No
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.ImmediateData = Yes
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.MaxConnections = 1
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 02:24:41 user nova-compute[75257]: node.session.iscsi.ERL = 0
Nov 14 02:24:41 user nova-compute[75257]: node.session.scan = manual
Nov 14 02:24:41 user nova-compute[75257]: node.session.reopen_max = 0
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].address = 172.16.0.220
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].port = 3260
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].startup = manual
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].tcp.window_size = 524288
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].tcp.type_of_service = 0
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].timeo.logout_timeout = 15
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].timeo.login_timeout = 15
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].timeo.auth_timeout = 45
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].iscsi.DataDigest = None
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].iscsi.IFMarker = No
Nov 14 02:24:41 user nova-compute[75257]: node.conn[0].iscsi.OFMarker = No
Nov 14 02:24:41 user nova-compute[75257]: # END RECORD
Nov 14 02:24:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.base [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<f3c72a5a-0bce-4ebe-b2da-61f7f08155cc> lazy-loaded attributes: resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:24:41 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Took 0.88 seconds to deallocate network for instance.
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9010be-2f72-4f15-8894-96d638e3ef83]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde5fd65-7bdc-42c3-95b7-5e25fe0552f1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cFpxJTIs {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cFpxJTIs" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3e589c-2eed-4c2b-ad19-c5bc8a1f8866]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cFpxJTIs'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc630bf2-39ca-448d-82c7-8b2e2b74f166]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef034ec-56b1-48f5-9261-80a71dd66b84]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:24:41 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:24:41 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:24:41 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:24:41 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:24:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:24:41 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:24:41 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:24:41 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:24:41 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:24:41 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.177s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] HCTL ('36', '0', '0', 0) found on session 47 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd09cc0-5af0-45d9-b737-147420a8d5d4]: (4, ('0 0 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Searching for a device in session 47 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFpxJTIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.204s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '23138623730633866', 'path': '/dev/sde'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138623730633866', 'path': '/dev/sde'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.network.neutron [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updated VIF entry in instance network info cache for port cd7b2500-ad09-43fc-ad92-8338dc32fcbe. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.network.neutron [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating instance_info_cache with network_info: [{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d8fda39d-cc7b-43db-8978-948b0746ad0a req-5dee1bc3-8a21-4c7b-bd63-57232bb73683 service nova] Releasing lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-893670019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-893670019',id=39,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:23:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-xoef4f6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:23:05Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=cbecb74e-b1af-404a-9fd6-050328413cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "vif_mac": "fa:16:3e:bd:51:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "vif_mac": "fa:16:3e:bd:51:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:51:7f,bridge_name='br-int',has_traffic_filtering=True,id=109d45a8-89e1-43d8-9134-d29c37330e20,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109d45a8-89') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'pci_devices' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.objects.base [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Object Instance<cbecb74e-b1af-404a-9fd6-050328413cac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:24:41 user nova-compute[75257]:   <uuid>cbecb74e-b1af-404a-9fd6-050328413cac</uuid>
Nov 14 02:24:41 user nova-compute[75257]:   <name>instance-00000027</name>
Nov 14 02:24:41 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:24:41 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:24:41 user nova-compute[75257]:   <metadata>
Nov 14 02:24:41 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:24:41 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:24:41 user nova-compute[75257]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-893670019</nova:name>
Nov 14 02:24:41 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:24:41</nova:creationTime>
Nov 14 02:24:41 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:24:41 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:24:41 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:24:41 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:24:41 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:24:41 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:24:41 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:24:41 user nova-compute[75257]:       <nova:owner>
Nov 14 02:24:41 user nova-compute[75257]:         <nova:user uuid="addcfdac50de4b03bd3ad3142508edea">tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member</nova:user>
Nov 14 02:24:41 user nova-compute[75257]:         <nova:project uuid="ac29176de8fc434285721bbb6759966d">tempest-ServerBootFromVolumeStableRescueTest-1355021813</nova:project>
Nov 14 02:24:41 user nova-compute[75257]:       </nova:owner>
Nov 14 02:24:41 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:24:41 user nova-compute[75257]:       <nova:ports>
Nov 14 02:24:41 user nova-compute[75257]:         <nova:port uuid="109d45a8-89e1-43d8-9134-d29c37330e20">
Nov 14 02:24:41 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:24:41 user nova-compute[75257]:         </nova:port>
Nov 14 02:24:41 user nova-compute[75257]:       </nova:ports>
Nov 14 02:24:41 user nova-compute[75257]:     </nova:instance>
Nov 14 02:24:41 user nova-compute[75257]:   </metadata>
Nov 14 02:24:41 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:24:41 user nova-compute[75257]:     <system>
Nov 14 02:24:41 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:24:41 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:24:41 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:24:41 user nova-compute[75257]:       <entry name="serial">cbecb74e-b1af-404a-9fd6-050328413cac</entry>
Nov 14 02:24:41 user nova-compute[75257]:       <entry name="uuid">cbecb74e-b1af-404a-9fd6-050328413cac</entry>
Nov 14 02:24:41 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:24:41 user nova-compute[75257]:     </system>
Nov 14 02:24:41 user nova-compute[75257]:   </sysinfo>
Nov 14 02:24:41 user nova-compute[75257]:   <os>
Nov 14 02:24:41 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:24:41 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:24:41 user nova-compute[75257]:   </os>
Nov 14 02:24:41 user nova-compute[75257]:   <features>
Nov 14 02:24:41 user nova-compute[75257]:     <acpi/>
Nov 14 02:24:41 user nova-compute[75257]:     <apic/>
Nov 14 02:24:41 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:24:41 user nova-compute[75257]:   </features>
Nov 14 02:24:41 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:24:41 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:24:41 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:24:41 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:24:41 user nova-compute[75257]:   </clock>
Nov 14 02:24:41 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:24:41 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:24:41 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:24:41 user nova-compute[75257]:   </cpu>
Nov 14 02:24:41 user nova-compute[75257]:   <devices>
Nov 14 02:24:41 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:24:41 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:24:41 user nova-compute[75257]:       <source dev="/dev/sde"/>
Nov 14 02:24:41 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:24:41 user nova-compute[75257]:       <serial>515fd521-1fd4-4c68-aef5-5916661c86b0</serial>
Nov 14 02:24:41 user nova-compute[75257]:     </disk>
Nov 14 02:24:41 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:24:41 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:24:41 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue"/>
Nov 14 02:24:41 user nova-compute[75257]:       <target dev="vdb" bus="virtio"/>
Nov 14 02:24:41 user nova-compute[75257]:       <boot order="1"/>
Nov 14 02:24:41 user nova-compute[75257]:     </disk>
Nov 14 02:24:41 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:24:41 user nova-compute[75257]:       <mac address="fa:16:3e:bd:51:7f"/>
Nov 14 02:24:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:24:41 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:24:41 user nova-compute[75257]:       <target dev="tap109d45a8-89"/>
Nov 14 02:24:41 user nova-compute[75257]:     </interface>
Nov 14 02:24:41 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:24:41 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/console.log" append="off"/>
Nov 14 02:24:41 user nova-compute[75257]:     </serial>
Nov 14 02:24:41 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:24:41 user nova-compute[75257]:     <video>
Nov 14 02:24:41 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:24:41 user nova-compute[75257]:     </video>
Nov 14 02:24:41 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:24:41 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:24:41 user nova-compute[75257]:     </rng>
Nov 14 02:24:41 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:24:41 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:24:41 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:24:41 user nova-compute[75257]:     </memballoon>
Nov 14 02:24:41 user nova-compute[75257]:   </devices>
Nov 14 02:24:41 user nova-compute[75257]: </domain>
Nov 14 02:24:41 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:24:41 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Instance destroyed successfully.
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] No VIF found with MAC fa:16:3e:bd:51:7f, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:24:41 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:24:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.371s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-26088645-1ce8-4e85-809a-0c4dd81abf46 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.261s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:42 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:24:42 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:24:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:42 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Deleted allocations for instance dcca61ed-4b5a-4966-8584-bde4f1954eb3
Nov 14 02:24:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-257ba4a3-b410-444f-9beb-57de4e372e30 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "dcca61ed-4b5a-4966-8584-bde4f1954eb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.722s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-7b57c41a-20fe-4c65-9e58-6b7e51151c93 req-34497752-1a99-4abc-a56d-76df06d9e7ce service nova] [instance: dcca61ed-4b5a-4966-8584-bde4f1954eb3] Received event network-vif-deleted-6e087160-8d8f-4fce-8f06-559aa76e24ad {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:45 user nova-compute[75257]: WARNING nova.compute.manager [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state active and task_state rescuing.
Nov 14 02:24:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:45 user nova-compute[75257]: WARNING nova.compute.manager [req-74f90caa-052c-45f9-bb58-2d33c9973ba4 req-f5044b89-e699-4fa8-997f-85225ba2c4ca service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state active and task_state rescuing.
Nov 14 02:24:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-0d00b2ed-73ba-45fc-8403-c13e75d9e190 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:24:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:49 user nova-compute[75257]: INFO nova.compute.manager [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Unrescuing
Nov 14 02:24:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:24:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquired lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:24:49 user nova-compute[75257]: DEBUG nova.network.neutron [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG nova.network.neutron [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updating instance_info_cache with network_info: [{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Releasing lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG nova.objects.instance [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'flavor' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-unplugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-unplugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:50 user nova-compute[75257]: WARNING nova.compute.manager [req-1e206fbc-e74b-491e-b24e-99b8ae75b8be req-7c3b8c9f-43ca-44f6-8941-c389548f77c1 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-unplugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:24:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:50 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Instance destroyed successfully.
Nov 14 02:24:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:51 user nova-compute[75257]: INFO nova.compute.manager [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Terminating instance
Nov 14 02:24:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received event network-vif-unplugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] Acquiring lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] No waiting events found dispatching network-vif-unplugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-d753568b-eabf-42cd-a43a-ed2076d39e1b req-c2894ce8-90d5-43d5-9a74-5ee760dba8e1 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received event network-vif-unplugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:24:52 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Instance destroyed successfully.
Nov 14 02:24:52 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lazy-loading 'resources' on Instance uuid 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1338652237',display_name='tempest-ServerActionsTestOtherA-server-1338652237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1338652237',id=5,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB39GOY0wPba7Se5P/ELgQHjSp5Y+c3TQj1v1fJ/o65opLemE7+iKgpB+rstjgLq6GIIRvjFkqIBY6YjtK4NjEAt6YhZcZbOLwMDyh19Gt9mOqSlqEcYIxS9ukMlacLww==',key_name='tempest-keypair-1627475945',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ba9547629f4ea1b40424e277e17d25',ramdisk_id='',reservation_id='r-4x0drdu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1988221692',owner_user_name='tempest-ServerActionsTestOtherA-1988221692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ffa5574e531479993ef301510f1d9e3',uuid=0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converting VIF {"id": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "address": "fa:16:3e:a7:80:0c", "network": {"id": "dc8c6c51-2843-43f4-95cf-8e873f067676", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1017750038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ba9547629f4ea1b40424e277e17d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap305a143e-a7", "ovs_interfaceid": "305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:80:0c,bridge_name='br-int',has_traffic_filtering=True,id=305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305a143e-a7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG os_vif [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:80:0c,bridge_name='br-int',has_traffic_filtering=True,id=305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305a143e-a7') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap305a143e-a7, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=736814b8-239b-4777-9728-69d2d42a1006) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: INFO os_vif [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:80:0c,bridge_name='br-int',has_traffic_filtering=True,id=305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c,network=Network(dc8c6c51-2843-43f4-95cf-8e873f067676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap305a143e-a7')
Nov 14 02:24:52 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Deleting instance files /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9_del
Nov 14 02:24:52 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Deletion of /opt/stack/data/nova/instances/0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9_del complete
Nov 14 02:24:52 user nova-compute[75257]: INFO nova.compute.manager [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 14 02:24:52 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:52 user nova-compute[75257]: WARNING nova.compute.manager [req-fa936ac8-82a8-400f-9b7d-44cc84ade912 req-931b0cb2-292f-47f9-944a-17029a46dff6 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:53 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Took 0.78 seconds to deallocate network for instance.
Nov 14 02:24:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received event network-vif-deleted-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:53 user nova-compute[75257]: INFO nova.compute.manager [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Neutron deleted interface 305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c; detaching it from the instance and deleting it from the info cache
Nov 14 02:24:53 user nova-compute[75257]: DEBUG nova.network.neutron [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-af0bcd7b-6bee-48a6-9299-94e47e09adde req-b3bc62b6-355e-43c7-b587-b595de4d50cb service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Detach interface failed, port_id=305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c, reason: Instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received event network-vif-plugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] Acquiring lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] No waiting events found dispatching network-vif-plugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:53 user nova-compute[75257]: WARNING nova.compute.manager [req-49f5b559-6439-45e0-ac1f-de91c50c1e8d req-1c017537-a3c4-4427-95a2-43c27df10ca6 service nova] [instance: 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9] Received unexpected event network-vif-plugged-305a143e-a7b0-4a63-bcc8-d9bb2d78cc5c for instance with vm_state deleted and task_state None.
Nov 14 02:24:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:24:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:53 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Deleted allocations for instance 0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9
Nov 14 02:24:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e74f8a75-27e9-4008-b3da-96c24f57d8a4 tempest-ServerActionsTestOtherA-1988221692 tempest-ServerActionsTestOtherA-1988221692-project-member] Lock "0d3dcfdf-47dc-4f97-afbb-e8772c06b8f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.749s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:54 user nova-compute[75257]: WARNING nova.compute.manager [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:24:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:24:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:24:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:24:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:24:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:24:54 user nova-compute[75257]: WARNING nova.compute.manager [req-bb11ac46-593c-4f0a-9bfa-1b72eeeb2385 req-bc3cacba-ef79-450d-b85d-c781e9505a7c service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:24:54 user nova-compute[75257]: DEBUG nova.compute.manager [None req-47a6206e-706d-4744-a2bc-534e71f838db tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:24:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:24:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:00 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:25:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:25:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:25:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:25:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:25:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:25:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:25:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-ba9ecc12-fe4e-4124-8f4c-2160cd08337b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:25:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-ba9ecc12-fe4e-4124-8f4c-2160cd08337b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:25:06 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:25:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Updating instance_info_cache with network_info: [{"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:25:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-ba9ecc12-fe4e-4124-8f4c-2160cd08337b" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:25:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:25:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:25:08 user nova-compute[75257]: INFO nova.compute.claims [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Claim successful on node user
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.264s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:25:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:25:08 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.policy [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2a805502f5d4186a0ade4f44bd0d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02ec183414b420e8758ffea80902171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:25:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Creating image(s)
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "/opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "/opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "/opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk 1073741824" returned: 0 in 0.050s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Successfully created port: a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Cannot resize image /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Ensure instance console log exists: /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Successfully updated port: a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquired lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received event network-changed-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Refreshing instance network info cache due to event network-changed-a2de0a50-a398-4b3b-86a8-86137531ca29. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] Acquiring lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating instance_info_cache with network_info: [{"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Releasing lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Instance network_info: |[{"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] Acquired lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.network.neutron [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Refreshing network info cache for port a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Start _get_guest_xml network_info=[{"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:25:10 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:25:10 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-851489065',display_name='tempest-SnapshotDataIntegrityTests-server-851489065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-851489065',id=43,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbyFDCLZjgfq+BHFlU+u5qU3pNwn+VrEWZP3k7XoYudOojzEOn6QNKy+4ixzPXb9ct7wd5zaqdaBlNS3NNvOQH5wRd4E8zalWV8GSDwmgErF1VE1iB8oUkqj4G9wkK7Dw==',key_name='tempest-keypair-1055575446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d02ec183414b420e8758ffea80902171',ramdisk_id='',reservation_id='r-86u85zjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-169282836',owner_user_name='tempest-SnapshotDataIntegrityTests-169282836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a805502f5d4186a0ade4f44bd0d161',uuid=053d9dbc-02cd-49b3-9476-02b32b4cb4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Converting VIF {"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:39,bridge_name='br-int',has_traffic_filtering=True,id=a2de0a50-a398-4b3b-86a8-86137531ca29,network=Network(3a6db057-93ae-4771-b205-bcf29044c756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2de0a50-a3') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'pci_devices' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:25:10 user nova-compute[75257]:   <uuid>053d9dbc-02cd-49b3-9476-02b32b4cb4a1</uuid>
Nov 14 02:25:10 user nova-compute[75257]:   <name>instance-0000002b</name>
Nov 14 02:25:10 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:25:10 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:25:10 user nova-compute[75257]:   <metadata>
Nov 14 02:25:10 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:25:10 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:25:10 user nova-compute[75257]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-851489065</nova:name>
Nov 14 02:25:10 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:25:10</nova:creationTime>
Nov 14 02:25:10 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:25:10 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:25:10 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:25:10 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:25:10 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:25:10 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:25:10 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:25:10 user nova-compute[75257]:       <nova:owner>
Nov 14 02:25:10 user nova-compute[75257]:         <nova:user uuid="b2a805502f5d4186a0ade4f44bd0d161">tempest-SnapshotDataIntegrityTests-169282836-project-member</nova:user>
Nov 14 02:25:10 user nova-compute[75257]:         <nova:project uuid="d02ec183414b420e8758ffea80902171">tempest-SnapshotDataIntegrityTests-169282836</nova:project>
Nov 14 02:25:10 user nova-compute[75257]:       </nova:owner>
Nov 14 02:25:10 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:25:10 user nova-compute[75257]:       <nova:ports>
Nov 14 02:25:10 user nova-compute[75257]:         <nova:port uuid="a2de0a50-a398-4b3b-86a8-86137531ca29">
Nov 14 02:25:10 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 02:25:10 user nova-compute[75257]:         </nova:port>
Nov 14 02:25:10 user nova-compute[75257]:       </nova:ports>
Nov 14 02:25:10 user nova-compute[75257]:     </nova:instance>
Nov 14 02:25:10 user nova-compute[75257]:   </metadata>
Nov 14 02:25:10 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:25:10 user nova-compute[75257]:     <system>
Nov 14 02:25:10 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:25:10 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:25:10 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:25:10 user nova-compute[75257]:       <entry name="serial">053d9dbc-02cd-49b3-9476-02b32b4cb4a1</entry>
Nov 14 02:25:10 user nova-compute[75257]:       <entry name="uuid">053d9dbc-02cd-49b3-9476-02b32b4cb4a1</entry>
Nov 14 02:25:10 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:25:10 user nova-compute[75257]:     </system>
Nov 14 02:25:10 user nova-compute[75257]:   </sysinfo>
Nov 14 02:25:10 user nova-compute[75257]:   <os>
Nov 14 02:25:10 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:25:10 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:25:10 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:25:10 user nova-compute[75257]:   </os>
Nov 14 02:25:10 user nova-compute[75257]:   <features>
Nov 14 02:25:10 user nova-compute[75257]:     <acpi/>
Nov 14 02:25:10 user nova-compute[75257]:     <apic/>
Nov 14 02:25:10 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:25:10 user nova-compute[75257]:   </features>
Nov 14 02:25:10 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:25:10 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:25:10 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:25:10 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:25:10 user nova-compute[75257]:   </clock>
Nov 14 02:25:10 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:25:10 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:25:10 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:25:10 user nova-compute[75257]:   </cpu>
Nov 14 02:25:10 user nova-compute[75257]:   <devices>
Nov 14 02:25:10 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:25:10 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:25:10 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk"/>
Nov 14 02:25:10 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:25:10 user nova-compute[75257]:     </disk>
Nov 14 02:25:10 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:25:10 user nova-compute[75257]:       <mac address="fa:16:3e:57:42:39"/>
Nov 14 02:25:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:25:10 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:25:10 user nova-compute[75257]:       <target dev="tapa2de0a50-a3"/>
Nov 14 02:25:10 user nova-compute[75257]:     </interface>
Nov 14 02:25:10 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:25:10 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/console.log" append="off"/>
Nov 14 02:25:10 user nova-compute[75257]:     </serial>
Nov 14 02:25:10 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:25:10 user nova-compute[75257]:     <video>
Nov 14 02:25:10 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:25:10 user nova-compute[75257]:     </video>
Nov 14 02:25:10 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:25:10 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:25:10 user nova-compute[75257]:     </rng>
Nov 14 02:25:10 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:25:10 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:25:10 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:25:10 user nova-compute[75257]:     </memballoon>
Nov 14 02:25:10 user nova-compute[75257]:   </devices>
Nov 14 02:25:10 user nova-compute[75257]: </domain>
Nov 14 02:25:10 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-851489065',display_name='tempest-SnapshotDataIntegrityTests-server-851489065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-851489065',id=43,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbyFDCLZjgfq+BHFlU+u5qU3pNwn+VrEWZP3k7XoYudOojzEOn6QNKy+4ixzPXb9ct7wd5zaqdaBlNS3NNvOQH5wRd4E8zalWV8GSDwmgErF1VE1iB8oUkqj4G9wkK7Dw==',key_name='tempest-keypair-1055575446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d02ec183414b420e8758ffea80902171',ramdisk_id='',reservation_id='r-86u85zjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-169282836',owner_user_name='tempest-SnapshotDataIntegrityTests-169282836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a805502f5d4186a0ade4f44bd0d161',uuid=053d9dbc-02cd-49b3-9476-02b32b4cb4a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Converting VIF {"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:39,bridge_name='br-int',has_traffic_filtering=True,id=a2de0a50-a398-4b3b-86a8-86137531ca29,network=Network(3a6db057-93ae-4771-b205-bcf29044c756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2de0a50-a3') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG os_vif [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:39,bridge_name='br-int',has_traffic_filtering=True,id=a2de0a50-a398-4b3b-86a8-86137531ca29,network=Network(3a6db057-93ae-4771-b205-bcf29044c756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2de0a50-a3') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c75e6885-07ee-5f2e-b530-4d38fcebe217', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2de0a50-a3, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2de0a50-a3, col_values=(('qos', UUID('3113a28a-e159-4123-9dee-52a8ecdf22c5')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2de0a50-a3, col_values=(('external_ids', {'iface-id': 'a2de0a50-a398-4b3b-86a8-86137531ca29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:42:39', 'vm-uuid': '053d9dbc-02cd-49b3-9476-02b32b4cb4a1'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:10 user nova-compute[75257]: INFO os_vif [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:39,bridge_name='br-int',has_traffic_filtering=True,id=a2de0a50-a398-4b3b-86a8-86137531ca29,network=Network(3a6db057-93ae-4771-b205-bcf29044c756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2de0a50-a3')
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No VIF found with MAC fa:16:3e:57:42:39, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updated VIF entry in instance network info cache for port a2de0a50-a398-4b3b-86a8-86137531ca29. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating instance_info_cache with network_info: [{"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8e9bd8de-54cb-46af-bd00-2579b5d312f5 req-92c8e95f-e6e2-425e-bcd9-cccbd3356649 service nova] Releasing lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received event network-vif-plugged-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] No waiting events found dispatching network-vif-plugged-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:25:12 user nova-compute[75257]: WARNING nova.compute.manager [req-21f07387-12e8-49a6-90ce-1ce900fe29e6 req-0974a6d6-0e47-4395-a32f-00898fab766c service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received unexpected event network-vif-plugged-a2de0a50-a398-4b3b-86a8-86137531ca29 for instance with vm_state building and task_state spawning.
Nov 14 02:25:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:25:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7611MB free_disk=24.876697540283203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 14f49370-77df-4e76-8e1d-4f89580315a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance cbecb74e-b1af-404a-9fd6-050328413cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:25:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:25:14 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Instance spawned successfully.
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received event network-vif-plugged-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.compute.manager [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] No waiting events found dispatching network-vif-plugged-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:25:14 user nova-compute[75257]: WARNING nova.compute.manager [req-912421cf-650b-4b90-8a08-020f4acbef71 req-25fececa-49a4-4f64-b136-11d883123c98 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received unexpected event network-vif-plugged-a2de0a50-a398-4b3b-86a8-86137531ca29 for instance with vm_state building and task_state spawning.
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:25:14 user nova-compute[75257]: INFO nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 14 02:25:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:25:14 user nova-compute[75257]: INFO nova.compute.manager [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Took 6.28 seconds to build instance.
Nov 14 02:25:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ef64eb41-f219-49cf-8a63-e1398e5bffc3 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.375s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:25:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received event network-changed-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:25:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Refreshing instance network info cache due to event network-changed-1fecad81-6dfa-495c-97d9-ebbdbb903a58. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:25:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] Acquiring lock "refresh_cache-4d2776db-0245-4ee0-ade9-8b87eaa44fae" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:25:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] Acquired lock "refresh_cache-4d2776db-0245-4ee0-ade9-8b87eaa44fae" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:25:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Refreshing network info cache for port 1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:25:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Updated VIF entry in instance network info cache for port 1fecad81-6dfa-495c-97d9-ebbdbb903a58. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:25:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Updating instance_info_cache with network_info: [{"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:25:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ee11fe04-bc02-4fb5-90fc-aaa4209a9f43 req-7a5a5962-0021-490e-8573-e5179daa1950 service nova] Releasing lock "refresh_cache-4d2776db-0245-4ee0-ade9-8b87eaa44fae" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG nova.objects.instance [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lazy-loading 'flavor' on Instance uuid 4d2776db-0245-4ee0-ade9-8b87eaa44fae {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:19 user nova-compute[75257]: INFO nova.compute.manager [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Attaching volume 95376504-c9da-4f60-83ad-bbc0fec363ca to /dev/vdb
Nov 14 02:25:19 user nova-compute[75257]: DEBUG os_brick.utils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b91c21-2e1f-4592-af4a-0a3a4b7a5b28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb8c360-7d06-4397-8dbd-431681f88f06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaa87a1-0a07-4662-8c0a-59956fbe8b69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2859059b-83cc-407f-af99-7a14bf6c5dc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:25:19 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:25:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd0dc5f-39c4-4301-a768-2ae4b95f3bd1]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG os_brick.utils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:25:19 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Updating existing volume attachment record: 79d4fedb-6657-4682-8f83-e66e65c86f77 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:25:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MoHixPJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:25:24 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:25:24 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:25:24 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[973b113e-6721-4f6e-9cb7-f7b9c2a17157]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:25:24 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a151a697-dc83-4715-a78f-2d4de9f4f056]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca] added
Nov 14 02:25:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1713d39-e204-49b2-8d49-4ca7a0feffed]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9b8dbf-91c9-4679-a123-0106d7a5fbe2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MoHixPJO {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MoHixPJO" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00b7cc-9523-431a-9b9e-e016561d546e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MoHixPJO'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3f0ef9-0e21-4137-a457-492cbeff05dd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e5a3bb-433b-4816-9223-85c45502ba6b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91963ce-8295-47c1-9369-25844b7a267d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca, portal: 172.16.0.220,3260]
Nov 14 02:25:24 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca, portal: 172.16.0.220,3260] successful.
Nov 14 02:25:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443ffd1-91ba-49bc-b33d-5a72db3b9f24]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[704ce1e1-96bb-4c68-8c07-f001a9c4b5a4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca (non-flash)
Nov 14 02:25:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:25:24 user nova-compute[75257]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca (non-flash)
Nov 14 02:25:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb735c3-a167-4df1-94ed-1d8b7621342d]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:25:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MoHixPJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23564643533623631', 'path': '/dev/sdf'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564643533623631', 'path': '/dev/sdf'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG nova.objects.instance [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lazy-loading 'flavor' on Instance uuid 4d2776db-0245-4ee0-ade9-8b87eaa44fae {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:25:25 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:25:25 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:25:25 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:25:25 user nova-compute[75257]:   <serial>95376504-c9da-4f60-83ad-bbc0fec363ca</serial>
Nov 14 02:25:25 user nova-compute[75257]: </disk>
Nov 14 02:25:25 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received event network-changed-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG nova.compute.manager [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Refreshing instance network info cache due to event network-changed-b8682a57-3293-47b6-9a6a-1149d39ceb33. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] Acquiring lock "refresh_cache-29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] Acquired lock "refresh_cache-29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG nova.network.neutron [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Refreshing network info cache for port b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:25:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] No VIF found with MAC fa:16:3e:fd:4e:1a, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c4d6fa1b-5d38-4942-a702-d1545fb64441 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.367s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG nova.network.neutron [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Updated VIF entry in instance network info cache for port b8682a57-3293-47b6-9a6a-1149d39ceb33. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG nova.network.neutron [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Updating instance_info_cache with network_info: [{"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-aaa53fbf-a23a-4208-881a-4fc3dc9f8bb8 req-ef7d4e9e-c9b0-42ec-b063-33f834e43b1d service nova] Releasing lock "refresh_cache-29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:26 user nova-compute[75257]: INFO nova.compute.manager [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Terminating instance
Nov 14 02:25:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received event network-vif-unplugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] Acquiring lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] No waiting events found dispatching network-vif-unplugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:25:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-dcdebb8c-76d5-4541-a116-870e31222426 req-f47128d2-9642-4f20-a4a4-85dd7da97152 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received event network-vif-unplugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:27 user nova-compute[75257]: INFO nova.compute.manager [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Detaching volume 95376504-c9da-4f60-83ad-bbc0fec363ca
Nov 14 02:25:27 user nova-compute[75257]: INFO nova.virt.block_device [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Attempting to driver detach volume 95376504-c9da-4f60-83ad-bbc0fec363ca from mountpoint /dev/vdb
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Attempting to detach device vdb from instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:25:27 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:25:27 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:25:27 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:25:27 user nova-compute[75257]:   <serial>95376504-c9da-4f60-83ad-bbc0fec363ca</serial>
Nov 14 02:25:27 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:25:27 user nova-compute[75257]: </disk>
Nov 14 02:25:27 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:25:27 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Instance destroyed successfully.
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.objects.instance [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'resources' on Instance uuid 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:25:27 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Successfully detached device vdb from instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae from the persistent domain config.
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:25:27 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:25:27 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:25:27 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:25:27 user nova-compute[75257]:   <serial>95376504-c9da-4f60-83ad-bbc0fec363ca</serial>
Nov 14 02:25:27 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:25:27 user nova-compute[75257]: </disk>
Nov 14 02:25:27 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1850980078',display_name='tempest-TestVolumeBootPattern-server-1850980078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1850980078',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA==',key_name='tempest-TestVolumeBootPattern-1177175426',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:23:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-teupum8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:23:45Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "address": "fa:16:3e:dc:31:58", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8682a57-32", "ovs_interfaceid": "b8682a57-3293-47b6-9a6a-1149d39ceb33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:31:58,bridge_name='br-int',has_traffic_filtering=True,id=b8682a57-3293-47b6-9a6a-1149d39ceb33,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8682a57-32') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_vif [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:31:58,bridge_name='br-int',has_traffic_filtering=True,id=b8682a57-3293-47b6-9a6a-1149d39ceb33,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8682a57-32') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8682a57-32, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8f7c526-2208-460b-9adf-5f843b302824) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:27 user nova-compute[75257]: INFO os_vif [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:31:58,bridge_name='br-int',has_traffic_filtering=True,id=b8682a57-3293-47b6-9a6a-1149d39ceb33,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8682a57-32')
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frXTbdAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:25:27 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8da62a-de09-43ef-b1df-1f5a6f2f457e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:25:27 user nova-compute[75257]: No targets found.
Nov 14 02:25:27 user nova-compute[75257]: iSNS:
Nov 14 02:25:27 user nova-compute[75257]: No targets found.
Nov 14 02:25:27 user nova-compute[75257]: STATIC:
Nov 14 02:25:27 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4
Nov 14 02:25:27 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:27 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:27 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64
Nov 14 02:25:27 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:27 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:27 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca
Nov 14 02:25:27 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:27 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:27 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:25:27 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:27 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:27 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:25:27 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:27 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:27 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:25:27 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:27 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:27 user nova-compute[75257]: FIRMWARE:
Nov 14 02:25:27 user nova-compute[75257]: No targets found.
Nov 14 02:25:27 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:25:27 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:25:27 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7aba7d-0ea2-4cb1-b6f3-a02d89761c23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5689fb6c-abca-4a8f-ad01-50016f7b254b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca (non-flash)
Nov 14 02:25:27 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:25:27 user nova-compute[75257]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca (non-flash)
Nov 14 02:25:27 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c657880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8'): ({'sdh'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Removing single pathed devices sdh {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1741742-83b1-4ef6-8594-9d7bbfc5077f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4504054d-985d-4df6-93e2-e51b22607870]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flushing IO for device /dev/sdh {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0872309d-034e-40f5-9631-c92355e9821f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd81cba-4dcd-44cb-92fc-390fe77a03f1]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] SCSI volumes sdh have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f2df8-d941-42a8-afc0-c3cf93f2070a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef0d392-583a-4226-9b0e-15d198a3e9f2]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260]
Nov 14 02:25:27 user nova-compute[75257]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260] successful.
Nov 14 02:25:27 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f02082e-8caa-4ab4-9094-5ba702d2b8a9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== disconnect_volume: return (356ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:25:27 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Deleting instance files /opt/stack/data/nova/instances/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335_del
Nov 14 02:25:27 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Deletion of /opt/stack/data/nova/instances/29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335_del complete
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:25:27 user nova-compute[75257]: INFO nova.compute.manager [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Took 1.52 seconds to destroy the instance on the hypervisor.
Nov 14 02:25:27 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:25:27 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:25:28 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:25:28 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Took 0.67 seconds to deallocate network for instance.
Nov 14 02:25:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-a61f42a2-89e7-4ab4-993a-6a9e476dc686 req-cf8d9f96-8a35-4f3c-978a-e4165fe1429a service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received event network-vif-deleted-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:25:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received event network-vif-plugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:25:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] Acquiring lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] No waiting events found dispatching network-vif-plugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:25:28 user nova-compute[75257]: WARNING nova.compute.manager [req-eecc4060-e4c7-45e8-97fd-04c4a02ecf77 req-a9ed340d-4bee-432b-8fca-8ef8d33bfa47 service nova] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Received unexpected event network-vif-plugged-b8682a57-3293-47b6-9a6a-1149d39ceb33 for instance with vm_state active and task_state deleting.
Nov 14 02:25:29 user nova-compute[75257]: INFO nova.compute.manager [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 02:25:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:29 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:25:29 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:25:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:29 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Deleted allocations for instance 29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335
Nov 14 02:25:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-09d71367-22dd-4275-946a-31e28b02794d tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "29c3b7c8-6ec3-4f32-a1a6-4f7a5e13c335" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.433s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:25:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:25:30 user nova-compute[75257]: INFO nova.compute.manager [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Detaching volume 22b7d354-46a0-4057-ba2c-bf04b07c31e4
Nov 14 02:25:30 user nova-compute[75257]: INFO nova.virt.block_device [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Attempting to driver detach volume 22b7d354-46a0-4057-ba2c-bf04b07c31e4 from mountpoint /dev/vdb
Nov 14 02:25:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Attempting to detach device vdb from instance 6bc79fc1-8d23-443f-99b5-2464e115a1be from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:25:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:25:30 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:25:30 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:25:30 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:25:30 user nova-compute[75257]:   <serial>22b7d354-46a0-4057-ba2c-bf04b07c31e4</serial>
Nov 14 02:25:30 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:25:30 user nova-compute[75257]: </disk>
Nov 14 02:25:30 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:25:30 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully detached device vdb from instance 6bc79fc1-8d23-443f-99b5-2464e115a1be from the persistent domain config.
Nov 14 02:25:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6bc79fc1-8d23-443f-99b5-2464e115a1be from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:25:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:25:30 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:25:30 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:25:30 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:25:30 user nova-compute[75257]:   <serial>22b7d354-46a0-4057-ba2c-bf04b07c31e4</serial>
Nov 14 02:25:30 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:25:30 user nova-compute[75257]: </disk>
Nov 14 02:25:30 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:25:30 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:25:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:47 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae is timed out.
Nov 14 02:25:47 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Successfully detached device vdb from instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae from the live domain config.
Nov 14 02:25:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MoHixPJO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:25:47 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:25:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab3409d-1aa3-4b52-a9d2-37ce17a6136b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:25:47 user nova-compute[75257]: No targets found.
Nov 14 02:25:47 user nova-compute[75257]: iSNS:
Nov 14 02:25:47 user nova-compute[75257]: No targets found.
Nov 14 02:25:47 user nova-compute[75257]: STATIC:
Nov 14 02:25:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4
Nov 14 02:25:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64
Nov 14 02:25:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca
Nov 14 02:25:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:25:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:47 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:25:47 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:47 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:47 user nova-compute[75257]: FIRMWARE:
Nov 14 02:25:47 user nova-compute[75257]: No targets found.
Nov 14 02:25:47 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:25:47 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:25:47 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:25:47 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b435a-5141-46b1-9943-3d3218f82db3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a4169-640d-413b-b2f9-94c64b4a6019]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:48 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:48 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:48 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:48 user nova-compute[75257]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca (non-flash)
Nov 14 02:25:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:48 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:48 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:48 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:48 user nova-compute[75257]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca (non-flash)
Nov 14 02:25:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c5f1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca'): ({'sdf'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Removing single pathed devices sdf {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3971b9c9-5558-4f00-8787-000586bd8405]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe3c8a9-6b61-4316-ab98-9cd9653fb4fb]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Flushing IO for device /dev/sdf {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[709deec1-3800-4c16-9bf8-4a8cc0e5d22a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab897d69-6ead-4449-b002-5ded07e933d0]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e57cf7-8384-4ce4-8a98-afcb99ee8095]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c698e0b-672a-4998-a01c-03c14a22b7af]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca, portal: 172.16.0.220,3260]
Nov 14 02:25:48 user nova-compute[75257]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca, portal: 172.16.0.220,3260] successful.
Nov 14 02:25:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95376504-c9da-4f60-83ad-bbc0fec363ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa9cab7-dceb-4282-b198-e6f20d9a9c44]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] <== disconnect_volume: return (325ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:25:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:25:49 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lazy-loading 'flavor' on Instance uuid 4d2776db-0245-4ee0-ade9-8b87eaa44fae {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:25:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6ddd47ef-9f65-4fd9-89b6-5c51c5b45895 tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.950s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:50 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6bc79fc1-8d23-443f-99b5-2464e115a1be is timed out.
Nov 14 02:25:50 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully detached device vdb from instance 6bc79fc1-8d23-443f-99b5-2464e115a1be from the live domain config.
Nov 14 02:25:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTRbjdAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:25:50 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adb841c-d9af-428b-b8f4-c84c06ca2baf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:25:50 user nova-compute[75257]: No targets found.
Nov 14 02:25:50 user nova-compute[75257]: iSNS:
Nov 14 02:25:50 user nova-compute[75257]: No targets found.
Nov 14 02:25:50 user nova-compute[75257]: STATIC:
Nov 14 02:25:50 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4
Nov 14 02:25:50 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:50 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:50 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64
Nov 14 02:25:50 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:50 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:50 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:25:50 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:50 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:50 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:25:50 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:25:50 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:25:50 user nova-compute[75257]: FIRMWARE:
Nov 14 02:25:50 user nova-compute[75257]: No targets found.
Nov 14 02:25:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:25:50 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:25:50 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b3931-6476-43f4-bf5d-bda27c3b3205]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e026fecc-2df2-4202-95d8-89b6763cab78]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:50 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:50 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:50 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:25:50 user nova-compute[75257]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 (non-flash)
Nov 14 02:25:50 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:25:50 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:25:50 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3b1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da6a26f-6ed6-415f-b5dc-13c81500a082]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3abe3f-6fd1-477c-9458-7c70a8247e5a]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d31eb1f-572b-4fb9-ba2b-a242caa0c268]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf84d38-7b48-4fac-80eb-260021882d37]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c69fcf-0ff6-497e-97f3-f3f0f1cd1fe7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2e0957-415d-4696-99ae-7890c92030aa]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4, portal: 172.16.0.220,3260]
Nov 14 02:25:51 user nova-compute[75257]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4, portal: 172.16.0.220,3260] successful.
Nov 14 02:25:51 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b7d354-46a0-4057-ba2c-bf04b07c31e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eba398-3852-47f4-8545-b9944c983139]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] <== disconnect_volume: return (296ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:25:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:25:52 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'flavor' on Instance uuid 6bc79fc1-8d23-443f-99b5-2464e115a1be {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:25:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f959e0bb-15eb-4db0-83a8-6cce162f9555 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.818s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:25:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:25:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:25:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:01 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:07 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:26:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:26:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:26:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:26:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:26:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 42cdcf9f-848c-4960-87ca-3a8afa145b6a {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updating instance_info_cache with network_info: [{"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-42cdcf9f-848c-4960-87ca-3a8afa145b6a" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:26:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=24.835887908935547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 6bc79fc1-8d23-443f-99b5-2464e115a1be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 14f49370-77df-4e76-8e1d-4f89580315a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance cbecb74e-b1af-404a-9fd6-050328413cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:26:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:26:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:26:18 user nova-compute[75257]: INFO nova.compute.claims [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Claim successful on node user
Nov 14 02:26:19 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:26:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:26:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG nova.policy [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:26:19 user nova-compute[75257]: INFO nova.virt.block_device [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Booting with volume 655abaca-9817-45dd-9bf8-480d3b8aeba8 at /dev/vda
Nov 14 02:26:19 user nova-compute[75257]: DEBUG os_brick.utils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a671ed-9e50-40b5-b9ef-5e6a4f2f81b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[397c33c3-858c-4351-bc58-af24a5e86763]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d416d0-1ae0-4633-9648-372730a1b622]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[867870b9-e06f-46e8-9992-bfcfa8f03545]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:26:19 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed4a49-368c-4107-83b9-b19471be3bea]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG os_brick.utils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Updating existing volume attachment record: 83e49aed-9c18-40c0-a9c1-1e1403fe9150 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:19 user nova-compute[75257]: INFO nova.compute.manager [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Terminating instance
Nov 14 02:26:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received event network-vif-unplugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] No waiting events found dispatching network-vif-unplugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-7bd8b049-c3cf-4304-a525-ed1a4c9870c4 req-88172070-2479-4402-b90b-0f031d3f5bc5 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received event network-vif-unplugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Successfully created port: f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:26:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Instance destroyed successfully.
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.objects.instance [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lazy-loading 'resources' on Instance uuid 4d2776db-0245-4ee0-ade9-8b87eaa44fae {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-765378703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-765378703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7653787',id=41,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNwTb2urTVLljSFUoM358TkxPplIcLrsExGy4PLF3r4Ehsu6aJYWb+8DHxXrLdPALDpXXE3Ne3ddgazJSGF/eYv9lJy+Pd3Zbm+a5WnOpVXLr8zFO/FMHhkfhV6vc8T9Q==',key_name='tempest-keypair-1580117513',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9aa4951950648f3a648099551dbbd07',ramdisk_id='',reservation_id='r-fepoh7h1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-73995857',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:23:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a4b4a5d083c42ff8dffe1308cb04d75',uuid=4d2776db-0245-4ee0-ade9-8b87eaa44fae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Converting VIF {"id": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "address": "fa:16:3e:fd:4e:1a", "network": {"id": "a3da3e1b-0b14-41dd-8801-7b05faf6a776", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-747869918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9aa4951950648f3a648099551dbbd07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fecad81-6d", "ovs_interfaceid": "1fecad81-6dfa-495c-97d9-ebbdbb903a58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=1fecad81-6dfa-495c-97d9-ebbdbb903a58,network=Network(a3da3e1b-0b14-41dd-8801-7b05faf6a776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecad81-6d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG os_vif [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=1fecad81-6dfa-495c-97d9-ebbdbb903a58,network=Network(a3da3e1b-0b14-41dd-8801-7b05faf6a776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecad81-6d') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fecad81-6d, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c408ee0-f0be-4d8b-aa35-336b02be804d) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:20 user nova-compute[75257]: INFO os_vif [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:4e:1a,bridge_name='br-int',has_traffic_filtering=True,id=1fecad81-6dfa-495c-97d9-ebbdbb903a58,network=Network(a3da3e1b-0b14-41dd-8801-7b05faf6a776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fecad81-6d')
Nov 14 02:26:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Deleting instance files /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae_del
Nov 14 02:26:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Deletion of /opt/stack/data/nova/instances/4d2776db-0245-4ee0-ade9-8b87eaa44fae_del complete
Nov 14 02:26:20 user nova-compute[75257]: INFO nova.compute.manager [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 14 02:26:20 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:20 user nova-compute[75257]: INFO nova.compute.manager [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Terminating instance
Nov 14 02:26:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-unplugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] No waiting events found dispatching network-vif-unplugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-d15e02fe-e2cd-4e02-b2f4-43579d8530a0 req-008ce1c7-59f2-47ff-8e88-9a6f527310e6 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-unplugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Successfully updated port: f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquired lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Instance destroyed successfully.
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.objects.instance [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'resources' on Instance uuid 6bc79fc1-8d23-443f-99b5-2464e115a1be {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2044879744',display_name='tempest-AttachVolumeNegativeTest-server-2044879744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2044879744',id=35,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl7faLyiziutpEyCrhRIdksI+U7pL8LoCdnPmNKFmtcaBmmF4UR1dwk+RU5o1eV6Prup3hKzl11gsZDIVF4WFNlc2j1N2f8xeBCstMWK3/dQVxhOBCuif1TlpGUbmr9Og==',key_name='tempest-keypair-438637596',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-w3d0jouf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:20:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=6bc79fc1-8d23-443f-99b5-2464e115a1be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "address": "fa:16:3e:cd:53:b7", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08dac99-5c", "ovs_interfaceid": "b08dac99-5ce4-4efa-bf90-82b90a1ca4c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:53:b7,bridge_name='br-int',has_traffic_filtering=True,id=b08dac99-5ce4-4efa-bf90-82b90a1ca4c7,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08dac99-5c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG os_vif [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:53:b7,bridge_name='br-int',has_traffic_filtering=True,id=b08dac99-5ce4-4efa-bf90-82b90a1ca4c7,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08dac99-5c') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb08dac99-5c, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=058c743b-1588-471c-a21a-e1138e964adb) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:21 user nova-compute[75257]: INFO os_vif [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:53:b7,bridge_name='br-int',has_traffic_filtering=True,id=b08dac99-5ce4-4efa-bf90-82b90a1ca4c7,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08dac99-5c')
Nov 14 02:26:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Deleting instance files /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be_del
Nov 14 02:26:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Deletion of /opt/stack/data/nova/instances/6bc79fc1-8d23-443f-99b5-2464e115a1be_del complete
Nov 14 02:26:21 user nova-compute[75257]: INFO nova.compute.manager [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 14 02:26:21 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:21 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Took 1.19 seconds to deallocate network for instance.
Nov 14 02:26:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-ea672a65-57e8-49fb-aa19-15def5503727 req-190ed0de-a488-44f8-ad5e-da2a684e4ce6 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received event network-vif-deleted-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Updating instance_info_cache with network_info: [{"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Releasing lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Instance network_info: |[{"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received event network-vif-plugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Acquiring lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] No waiting events found dispatching network-vif-plugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:22 user nova-compute[75257]: WARNING nova.compute.manager [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] [instance: 4d2776db-0245-4ee0-ade9-8b87eaa44fae] Received unexpected event network-vif-plugged-1fecad81-6dfa-495c-97d9-ebbdbb903a58 for instance with vm_state deleted and task_state None.
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received event network-changed-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Refreshing instance network info cache due to event network-changed-f2ab062e-af46-4816-8393-d3632a9607bd. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Acquiring lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Acquired lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Refreshing network info cache for port f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:22 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Deleted allocations for instance 4d2776db-0245-4ee0-ade9-8b87eaa44fae
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Updated VIF entry in instance network info cache for port f2ab062e-af46-4816-8393-d3632a9607bd. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.network.neutron [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Updating instance_info_cache with network_info: [{"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ae6b0f9e-5596-481e-ae55-8c157d38d920 req-4b7029c4-5106-4c48-8c31-ebc29c18c067 service nova] Releasing lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-54b91ae3-21da-4d17-b6f6-97376cccd97b tempest-TestServerVolumeAttachScenarioOldVersion-73995857 tempest-TestServerVolumeAttachScenarioOldVersion-73995857-project-member] Lock "4d2776db-0245-4ee0-ade9-8b87eaa44fae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.999s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:22 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Took 0.96 seconds to deallocate network for instance.
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] No waiting events found dispatching network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:23 user nova-compute[75257]: WARNING nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received unexpected event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance with vm_state deleted and task_state None.
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] No waiting events found dispatching network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:23 user nova-compute[75257]: WARNING nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received unexpected event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance with vm_state deleted and task_state None.
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] No waiting events found dispatching network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:23 user nova-compute[75257]: WARNING nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received unexpected event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance with vm_state deleted and task_state None.
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-unplugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] No waiting events found dispatching network-vif-unplugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:23 user nova-compute[75257]: WARNING nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received unexpected event network-vif-unplugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance with vm_state deleted and task_state None.
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Acquiring lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] No waiting events found dispatching network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:23 user nova-compute[75257]: WARNING nova.compute.manager [req-ddf5999c-0f63-4f2c-977e-c11ef6a77f82 req-35d8123b-5f91-486d-a8c8-be6e788e4292 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received unexpected event network-vif-plugged-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 for instance with vm_state deleted and task_state None.
Nov 14 02:26:23 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:23 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Deleted allocations for instance 6bc79fc1-8d23-443f-99b5-2464e115a1be
Nov 14 02:26:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-13cbf828-ff49-4b31-8276-0ef10399af20 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "6bc79fc1-8d23-443f-99b5-2464e115a1be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.542s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-dde1f339-3be6-4280-8509-64849cb3bd76 req-7972fc2f-c864-4546-8868-87f89439d3d3 service nova] [instance: 6bc79fc1-8d23-443f-99b5-2464e115a1be] Received event network-vif-deleted-b08dac99-5ce4-4efa-bf90-82b90a1ca4c7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:26:24 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Creating image(s)
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Ensure instance console log exists: /opt/stack/data/nova/instances/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Start _get_guest_xml network_info=[{"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '83e49aed-9c18-40c0-a9c1-1e1403fe9150', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frXTbdAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9e501a3-dbf6-494f-8f24-50e2d2afa2fe', 'attached_at': '', 'detached_at': '', 'volume_id': '655abaca-9817-45dd-9bf8-480d3b8aeba8', 'serial': '655abaca-9817-45dd-9bf8-480d3b8aeba8'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:26:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:26:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frXTbdAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:26:24 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:26:24 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:26:24 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8f2259-2fc6-4337-bdf6-0b23679d34b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:26:24 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b1ff79-a2d6-4265-873e-4d2f537a00ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8] added
Nov 14 02:26:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4943fb-8bae-41fc-816b-1849f47b93d3]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3e8827-ea39-4e17-abee-8184a6974278]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frXTbdAu {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v frXTbdAu" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[589b4370-44ab-4c16-af69-09f33e5db60a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'frXTbdAu'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19cdc5c-3d93-4314-8468-2e41d3ee4111]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7d0f98-53bb-44c9-85b2-f36a6d144099]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ddcf3a-1236-41b5-9e05-3b431ac9ddeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260]
Nov 14 02:26:24 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260] successful.
Nov 14 02:26:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[43456577-3e9e-4637-bbba-4c1c308a8e3b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6d376b-de4b-460e-bc53-33d4c3c882f4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:26:24 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[39175c2f-e980-494e-9bc2-96787a8b1ca0]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:24 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frXTbdAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26135353932656464', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135353932656464', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2050395413',display_name='tempest-TestVolumeBootPattern-server-2050395413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2050395413',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA==',key_name='tempest-TestVolumeBootPattern-1177175426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-65325dtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:26:19Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=a9e501a3-dbf6-494f-8f24-50e2d2afa2fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:cb:bb,bridge_name='br-int',has_traffic_filtering=True,id=f2ab062e-af46-4816-8393-d3632a9607bd,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ab062e-af') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'pci_devices' on Instance uuid a9e501a3-dbf6-494f-8f24-50e2d2afa2fe {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:26:25 user nova-compute[75257]:   <uuid>a9e501a3-dbf6-494f-8f24-50e2d2afa2fe</uuid>
Nov 14 02:26:25 user nova-compute[75257]:   <name>instance-0000002c</name>
Nov 14 02:26:25 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:26:25 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:26:25 user nova-compute[75257]:   <metadata>
Nov 14 02:26:25 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:26:25 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:26:25 user nova-compute[75257]:       <nova:name>tempest-TestVolumeBootPattern-server-2050395413</nova:name>
Nov 14 02:26:25 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:26:24</nova:creationTime>
Nov 14 02:26:25 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:26:25 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:26:25 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:26:25 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:26:25 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:26:25 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:26:25 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:26:25 user nova-compute[75257]:       <nova:owner>
Nov 14 02:26:25 user nova-compute[75257]:         <nova:user uuid="61052c8663184644aa445e8b29a9d6ed">tempest-TestVolumeBootPattern-1633655156-project-member</nova:user>
Nov 14 02:26:25 user nova-compute[75257]:         <nova:project uuid="6e49d1cf0a1c457ab943ffd360f1c3da">tempest-TestVolumeBootPattern-1633655156</nova:project>
Nov 14 02:26:25 user nova-compute[75257]:       </nova:owner>
Nov 14 02:26:25 user nova-compute[75257]:       <nova:ports>
Nov 14 02:26:25 user nova-compute[75257]:         <nova:port uuid="f2ab062e-af46-4816-8393-d3632a9607bd">
Nov 14 02:26:25 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 02:26:25 user nova-compute[75257]:         </nova:port>
Nov 14 02:26:25 user nova-compute[75257]:       </nova:ports>
Nov 14 02:26:25 user nova-compute[75257]:     </nova:instance>
Nov 14 02:26:25 user nova-compute[75257]:   </metadata>
Nov 14 02:26:25 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:26:25 user nova-compute[75257]:     <system>
Nov 14 02:26:25 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:26:25 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:26:25 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:26:25 user nova-compute[75257]:       <entry name="serial">a9e501a3-dbf6-494f-8f24-50e2d2afa2fe</entry>
Nov 14 02:26:25 user nova-compute[75257]:       <entry name="uuid">a9e501a3-dbf6-494f-8f24-50e2d2afa2fe</entry>
Nov 14 02:26:25 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:26:25 user nova-compute[75257]:     </system>
Nov 14 02:26:25 user nova-compute[75257]:   </sysinfo>
Nov 14 02:26:25 user nova-compute[75257]:   <os>
Nov 14 02:26:25 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:26:25 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:26:25 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:26:25 user nova-compute[75257]:   </os>
Nov 14 02:26:25 user nova-compute[75257]:   <features>
Nov 14 02:26:25 user nova-compute[75257]:     <acpi/>
Nov 14 02:26:25 user nova-compute[75257]:     <apic/>
Nov 14 02:26:25 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:26:25 user nova-compute[75257]:   </features>
Nov 14 02:26:25 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:26:25 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:26:25 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:26:25 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:26:25 user nova-compute[75257]:   </clock>
Nov 14 02:26:25 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:26:25 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:26:25 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:26:25 user nova-compute[75257]:   </cpu>
Nov 14 02:26:25 user nova-compute[75257]:   <devices>
Nov 14 02:26:25 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:26:25 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:26:25 user nova-compute[75257]:       <source dev="/dev/sdb"/>
Nov 14 02:26:25 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:26:25 user nova-compute[75257]:       <serial>655abaca-9817-45dd-9bf8-480d3b8aeba8</serial>
Nov 14 02:26:25 user nova-compute[75257]:     </disk>
Nov 14 02:26:25 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:26:25 user nova-compute[75257]:       <mac address="fa:16:3e:11:cb:bb"/>
Nov 14 02:26:25 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:26:25 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:26:25 user nova-compute[75257]:       <target dev="tapf2ab062e-af"/>
Nov 14 02:26:25 user nova-compute[75257]:     </interface>
Nov 14 02:26:25 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:26:25 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe/console.log" append="off"/>
Nov 14 02:26:25 user nova-compute[75257]:     </serial>
Nov 14 02:26:25 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:26:25 user nova-compute[75257]:     <video>
Nov 14 02:26:25 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:26:25 user nova-compute[75257]:     </video>
Nov 14 02:26:25 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:26:25 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:26:25 user nova-compute[75257]:     </rng>
Nov 14 02:26:25 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:26:25 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:26:25 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:26:25 user nova-compute[75257]:     </memballoon>
Nov 14 02:26:25 user nova-compute[75257]:   </devices>
Nov 14 02:26:25 user nova-compute[75257]: </domain>
Nov 14 02:26:25 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2050395413',display_name='tempest-TestVolumeBootPattern-server-2050395413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2050395413',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA==',key_name='tempest-TestVolumeBootPattern-1177175426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-65325dtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:26:19Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=a9e501a3-dbf6-494f-8f24-50e2d2afa2fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:cb:bb,bridge_name='br-int',has_traffic_filtering=True,id=f2ab062e-af46-4816-8393-d3632a9607bd,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ab062e-af') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG os_vif [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:cb:bb,bridge_name='br-int',has_traffic_filtering=True,id=f2ab062e-af46-4816-8393-d3632a9607bd,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ab062e-af') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f19775b4-93a5-52ab-9c22-525f55de790e', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2ab062e-af, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2ab062e-af, col_values=(('qos', UUID('847b1582-ae23-4354-becc-f2d5fb9e93cd')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2ab062e-af, col_values=(('external_ids', {'iface-id': 'f2ab062e-af46-4816-8393-d3632a9607bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:cb:bb', 'vm-uuid': 'a9e501a3-dbf6-494f-8f24-50e2d2afa2fe'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:25 user nova-compute[75257]: INFO os_vif [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:cb:bb,bridge_name='br-int',has_traffic_filtering=True,id=f2ab062e-af46-4816-8393-d3632a9607bd,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ab062e-af')
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:26:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No VIF found with MAC fa:16:3e:11:cb:bb, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:26:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:26 user nova-compute[75257]: INFO nova.compute.manager [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Unshelving
Nov 14 02:26:26 user nova-compute[75257]: INFO nova.virt.block_device [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Booting with volume 02c3bf99-692c-40d2-92a2-99a680635aad at /dev/vdc
Nov 14 02:26:26 user nova-compute[75257]: DEBUG os_brick.utils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:26:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:26 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:26 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0ae0c4-c65f-4ece-8c26-5781b5fbf1dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb0ee94-cc93-4d97-bd00-64a9c8aaedee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2464f1b8-a452-4068-ac03-f62bf8e131f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b84b80-5410-4d7f-b73f-a72d18c38955]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:26:27 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4faefdc-dd89-4ec5-9bca-dd412d85e9e1]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG os_brick.utils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating existing volume attachment record: 9e5c6910-5763-409a-98c5-648b075fd876 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received event network-vif-plugged-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] Acquiring lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG nova.compute.manager [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] No waiting events found dispatching network-vif-plugged-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:27 user nova-compute[75257]: WARNING nova.compute.manager [req-080162a8-55de-47a7-a92a-910c42e2ee35 req-7af1d95b-feb6-4e27-9caa-fd61975e8910 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received unexpected event network-vif-plugged-f2ab062e-af46-4816-8393-d3632a9607bd for instance with vm_state building and task_state spawning.
Nov 14 02:26:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:28 user nova-compute[75257]: INFO nova.compute.manager [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Unrescuing
Nov 14 02:26:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:26:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquired lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:26:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:26:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Instance spawned successfully.
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Updating instance_info_cache with network_info: [{"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Releasing lock "refresh_cache-cbecb74e-b1af-404a-9fd6-050328413cac" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'flavor' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received event network-vif-plugged-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] Acquiring lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] No waiting events found dispatching network-vif-plugged-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:29 user nova-compute[75257]: WARNING nova.compute.manager [req-0d004c09-e5ae-44a4-8f79-63fce54ab51f req-40d00fd6-59e5-400c-bd7e-bb54de75e716 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received unexpected event network-vif-plugged-f2ab062e-af46-4816-8393-d3632a9607bd for instance with vm_state building and task_state spawning.
Nov 14 02:26:29 user nova-compute[75257]: INFO nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:29 user nova-compute[75257]: INFO nova.compute.manager [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Took 10.82 seconds to build instance.
Nov 14 02:26:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6519bbf2-30f6-4cc5-81c1-c455ad47dfba tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.919s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-unplugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-unplugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:29 user nova-compute[75257]: WARNING nova.compute.manager [req-37fb4cce-4f86-4332-9d3f-56ef1f783369 req-8df96459-cd8c-4050-85ed-8163928bf6a2 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-unplugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:26:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:30 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Instance destroyed successfully.
Nov 14 02:26:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:31 user nova-compute[75257]: WARNING nova.compute.manager [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:26:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG nova.compute.manager [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:31 user nova-compute[75257]: WARNING nova.compute.manager [req-b6647b4b-7ba7-4dda-aa67-56898ae453ce req-70c247c6-098c-4182-a6b1-41f17d56f4e6 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state rescued and task_state unrescuing.
Nov 14 02:26:31 user nova-compute[75257]: DEBUG nova.objects.instance [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'pci_requests' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG nova.objects.instance [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'numa_topology' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:31 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:26:31 user nova-compute[75257]: INFO nova.compute.claims [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Claim successful on node user
Nov 14 02:26:32 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:26:32 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:26:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:32 user nova-compute[75257]: INFO nova.network.neutron [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating port cd7b2500-ad09-43fc-ad92-8338dc32fcbe with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 02:26:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:26:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquired lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:26:32 user nova-compute[75257]: DEBUG nova.network.neutron [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cd0287e4-68f2-4f22-92f1-ce535b54559d tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG nova.network.neutron [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating instance_info_cache with network_info: [{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Releasing lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:26:33 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Creating image(s)
Nov 14 02:26:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG nova.objects.instance [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'trusted_certs' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG nova.objects.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<f3c72a5a-0bce-4ebe-b2da-61f7f08155cc> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "0a0f0b44b35631f29214d20f37eb8557e1d22d33" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "0a0f0b44b35631f29214d20f37eb8557e1d22d33" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:34 user nova-compute[75257]: WARNING nova.compute.manager [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state active and task_state None.
Nov 14 02:26:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-changed-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Refreshing instance network info cache due to event network-changed-cd7b2500-ad09-43fc-ad92-8338dc32fcbe. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Acquiring lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Acquired lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG nova.network.neutron [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Refreshing network info cache for port cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33.part --force-share --output=json" returned: 0 in 0.199s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG nova.virt.images [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 40cb1e44-becc-4426-82e6-67b6680c8e88 was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:26:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33.part /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG nova.network.neutron [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updated VIF entry in instance network info cache for port cd7b2500-ad09-43fc-ad92-8338dc32fcbe. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG nova.network.neutron [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating instance_info_cache with network_info: [{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-095cdcdf-e6c8-4dff-99e8-8b59d69731a9 req-98f959f2-6b59-48a1-ba97-9cf50533ffb7 service nova] Releasing lock "refresh_cache-f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33.part /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33.converted" returned: 0 in 0.593s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "0a0f0b44b35631f29214d20f37eb8557e1d22d33" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.044s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33 --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "0a0f0b44b35631f29214d20f37eb8557e1d22d33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "0a0f0b44b35631f29214d20f37eb8557e1d22d33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33 --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33,backing_fmt=raw /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33,backing_fmt=raw /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk 1073741824" returned: 0 in 0.099s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "0a0f0b44b35631f29214d20f37eb8557e1d22d33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33 --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG nova.objects.instance [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'migration_context' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG nova.objects.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<f3c72a5a-0bce-4ebe-b2da-61f7f08155cc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:26:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Rebasing disk image.
Nov 14 02:26:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 -F raw /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 -F raw /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk" returned: 0 in 2.067s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Ensure instance console log exists: /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Start _get_guest_xml network_info=[{"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b84a40e92ed010e34907006be7fcb35e',container_format='bare',created_at=2023-11-14T02:24:35Z,direct_url=<?>,disk_format='qcow2',id=40cb1e44-becc-4426-82e6-67b6680c8e88,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-432527132-shelved',owner='4c246fb95dcc49fd910ec526b1977fc8',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T02:24:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9e5c6910-5763-409a-98c5-648b075fd876', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOvTHFnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f3c72a5a-0bce-4ebe-b2da-61f7f08155cc', 'attached_at': '', 'detached_at': '', 'volume_id': '02c3bf99-692c-40d2-92a2-99a680635aad', 'serial': '02c3bf99-692c-40d2-92a2-99a680635aad'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:26:38 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:26:38 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b84a40e92ed010e34907006be7fcb35e',container_format='bare',created_at=2023-11-14T02:24:35Z,direct_url=<?>,disk_format='qcow2',id=40cb1e44-becc-4426-82e6-67b6680c8e88,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-432527132-shelved',owner='4c246fb95dcc49fd910ec526b1977fc8',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T02:24:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.objects.instance [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.objects.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<f3c72a5a-0bce-4ebe-b2da-61f7f08155cc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOvTHFnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:26:38 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:26:38 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:26:38 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4591d19b-aa8c-42b9-b9d4-56ca0b0c0287]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:26:38 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb2f12d-6358-4ae3-9adf-527874f3c2bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad] added
Nov 14 02:26:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcebe658-df2e-497f-996d-edb70a2b39af]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc33fa4-5990-4d1d-9464-e9b716def068]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOvTHFnV {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOvTHFnV" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd5b3e0-5905-4e32-9ad3-10096ba8586c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eOvTHFnV'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9188dd75-eeaa-4644-b7ac-836a95207a04]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3805b489-472a-4899-b361-2ebf3d3f61fd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:26:38 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:26:38 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:26:38 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:26:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:26:38 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:26:38 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:26:38 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:26:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:26:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a996202-f224-4dfe-86bf-72656491257c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad, portal: 172.16.0.220,3260]
Nov 14 02:26:39 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad, portal: 172.16.0.220,3260] successful.
Nov 14 02:26:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fb306a-531d-404b-b964-a9b0efffb07e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cc06ba-2be0-454b-b00f-a2bde30547d5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:26:39 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:26:39 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:26:39 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:26:39 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:26:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:26:39 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:26:39 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:26:39 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:26:39 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:26:39 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] HCTL ('37', '-', '-', 0) found on session 52 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59fd175-5b18-4e07-8cdd-2fd94f69ab51]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Searching for a device in session 52 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:26:39 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOvTHFnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23034643536326338', 'path': '/dev/sdf'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034643536326338', 'path': '/dev/sdf'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432527132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432527132',id=38,image_ref='40cb1e44-becc-4426-82e6-67b6680c8e88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1542235845',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-xuuad11y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member',shelved_at='2023-11-14T02:24:38.957102',shelved_host='user',shelved_image_id='40cb1e44-becc-4426-82e6-67b6680c8e88'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=f3c72a5a-0bce-4ebe-b2da-61f7f08155cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.objects.instance [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'pci_devices' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.objects.base [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<f3c72a5a-0bce-4ebe-b2da-61f7f08155cc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:26:40 user nova-compute[75257]:   <uuid>f3c72a5a-0bce-4ebe-b2da-61f7f08155cc</uuid>
Nov 14 02:26:40 user nova-compute[75257]:   <name>instance-00000026</name>
Nov 14 02:26:40 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:26:40 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:26:40 user nova-compute[75257]:   <metadata>
Nov 14 02:26:40 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:26:40 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:26:40 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-432527132</nova:name>
Nov 14 02:26:40 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:26:38</nova:creationTime>
Nov 14 02:26:40 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:26:40 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:26:40 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:26:40 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:26:40 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:26:40 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:26:40 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:26:40 user nova-compute[75257]:       <nova:owner>
Nov 14 02:26:40 user nova-compute[75257]:         <nova:user uuid="d50e0e5a436243f2a91c012a4996185c">tempest-AttachVolumeShelveTestJSON-1725343669-project-member</nova:user>
Nov 14 02:26:40 user nova-compute[75257]:         <nova:project uuid="4c246fb95dcc49fd910ec526b1977fc8">tempest-AttachVolumeShelveTestJSON-1725343669</nova:project>
Nov 14 02:26:40 user nova-compute[75257]:       </nova:owner>
Nov 14 02:26:40 user nova-compute[75257]:       <nova:root type="image" uuid="40cb1e44-becc-4426-82e6-67b6680c8e88"/>
Nov 14 02:26:40 user nova-compute[75257]:       <nova:ports>
Nov 14 02:26:40 user nova-compute[75257]:         <nova:port uuid="cd7b2500-ad09-43fc-ad92-8338dc32fcbe">
Nov 14 02:26:40 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 02:26:40 user nova-compute[75257]:         </nova:port>
Nov 14 02:26:40 user nova-compute[75257]:       </nova:ports>
Nov 14 02:26:40 user nova-compute[75257]:     </nova:instance>
Nov 14 02:26:40 user nova-compute[75257]:   </metadata>
Nov 14 02:26:40 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:26:40 user nova-compute[75257]:     <system>
Nov 14 02:26:40 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:26:40 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:26:40 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:26:40 user nova-compute[75257]:       <entry name="serial">f3c72a5a-0bce-4ebe-b2da-61f7f08155cc</entry>
Nov 14 02:26:40 user nova-compute[75257]:       <entry name="uuid">f3c72a5a-0bce-4ebe-b2da-61f7f08155cc</entry>
Nov 14 02:26:40 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:26:40 user nova-compute[75257]:     </system>
Nov 14 02:26:40 user nova-compute[75257]:   </sysinfo>
Nov 14 02:26:40 user nova-compute[75257]:   <os>
Nov 14 02:26:40 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:26:40 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:26:40 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:26:40 user nova-compute[75257]:   </os>
Nov 14 02:26:40 user nova-compute[75257]:   <features>
Nov 14 02:26:40 user nova-compute[75257]:     <acpi/>
Nov 14 02:26:40 user nova-compute[75257]:     <apic/>
Nov 14 02:26:40 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:26:40 user nova-compute[75257]:   </features>
Nov 14 02:26:40 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:26:40 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:26:40 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:26:40 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:26:40 user nova-compute[75257]:   </clock>
Nov 14 02:26:40 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:26:40 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:26:40 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:26:40 user nova-compute[75257]:   </cpu>
Nov 14 02:26:40 user nova-compute[75257]:   <devices>
Nov 14 02:26:40 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:26:40 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:26:40 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk"/>
Nov 14 02:26:40 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:26:40 user nova-compute[75257]:     </disk>
Nov 14 02:26:40 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:26:40 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:26:40 user nova-compute[75257]:       <source dev="/dev/sdf"/>
Nov 14 02:26:40 user nova-compute[75257]:       <target dev="vdc" bus="virtio"/>
Nov 14 02:26:40 user nova-compute[75257]:       <serial>02c3bf99-692c-40d2-92a2-99a680635aad</serial>
Nov 14 02:26:40 user nova-compute[75257]:     </disk>
Nov 14 02:26:40 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:26:40 user nova-compute[75257]:       <mac address="fa:16:3e:b3:1c:83"/>
Nov 14 02:26:40 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:26:40 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:26:40 user nova-compute[75257]:       <target dev="tapcd7b2500-ad"/>
Nov 14 02:26:40 user nova-compute[75257]:     </interface>
Nov 14 02:26:40 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:26:40 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/console.log" append="off"/>
Nov 14 02:26:40 user nova-compute[75257]:     </serial>
Nov 14 02:26:40 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:26:40 user nova-compute[75257]:     <video>
Nov 14 02:26:40 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:26:40 user nova-compute[75257]:     </video>
Nov 14 02:26:40 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:26:40 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:26:40 user nova-compute[75257]:     </rng>
Nov 14 02:26:40 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:26:40 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:26:40 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:26:40 user nova-compute[75257]:     </memballoon>
Nov 14 02:26:40 user nova-compute[75257]:   </devices>
Nov 14 02:26:40 user nova-compute[75257]: </domain>
Nov 14 02:26:40 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432527132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432527132',id=38,image_ref='40cb1e44-becc-4426-82e6-67b6680c8e88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1542235845',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:22:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-xuuad11y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member',shelved_at='2023-11-14T02:24:38.957102',shelved_host='user',shelved_image_id='40cb1e44-becc-4426-82e6-67b6680c8e88'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=f3c72a5a-0bce-4ebe-b2da-61f7f08155cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG os_vif [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb14b83a-3202-5e03-b7aa-ef8943370e08', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd7b2500-ad, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd7b2500-ad, col_values=(('qos', UUID('526799af-da74-4a5c-94b8-08af227d3b30')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd7b2500-ad, col_values=(('external_ids', {'iface-id': 'cd7b2500-ad09-43fc-ad92-8338dc32fcbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:1c:83', 'vm-uuid': 'f3c72a5a-0bce-4ebe-b2da-61f7f08155cc'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:40 user nova-compute[75257]: INFO os_vif [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad')
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:26:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] No VIF found with MAC fa:16:3e:b3:1c:83, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-changed-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG nova.compute.manager [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Refreshing instance network info cache due to event network-changed-cbd77511-3da8-4b8f-bd1c-bb5e9992f811. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] Acquiring lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] Acquired lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG nova.network.neutron [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Refreshing network info cache for port cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:41 user nova-compute[75257]: INFO nova.compute.manager [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Detaching volume fc412155-c035-4969-aa7f-9e1bc62a4e64
Nov 14 02:26:42 user nova-compute[75257]: INFO nova.virt.block_device [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Attempting to driver detach volume fc412155-c035-4969-aa7f-9e1bc62a4e64 from mountpoint /dev/vdb
Nov 14 02:26:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Attempting to detach device vdb from instance 14f49370-77df-4e76-8e1d-4f89580315a4 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:26:42 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:26:42 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:26:42 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:26:42 user nova-compute[75257]:   <serial>fc412155-c035-4969-aa7f-9e1bc62a4e64</serial>
Nov 14 02:26:42 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:26:42 user nova-compute[75257]: </disk>
Nov 14 02:26:42 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:26:42 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Successfully detached device vdb from instance 14f49370-77df-4e76-8e1d-4f89580315a4 from the persistent domain config.
Nov 14 02:26:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14f49370-77df-4e76-8e1d-4f89580315a4 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:26:42 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:26:42 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:26:42 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:26:42 user nova-compute[75257]:   <serial>fc412155-c035-4969-aa7f-9e1bc62a4e64</serial>
Nov 14 02:26:42 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:26:42 user nova-compute[75257]: </disk>
Nov 14 02:26:42 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG nova.network.neutron [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updated VIF entry in instance network info cache for port cbd77511-3da8-4b8f-bd1c-bb5e9992f811. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG nova.network.neutron [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updating instance_info_cache with network_info: [{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG nova.compute.manager [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] No waiting events found dispatching network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:42 user nova-compute[75257]: WARNING nova.compute.manager [req-28409759-ff6c-4f89-b4a0-84a5f52fd174 req-a32d661a-ebc9-4bb9-85ca-d69781352d09 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received unexpected event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 02:26:42 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-77d1e589-6f23-4d5c-87cd-7131ece31b66 req-6d7767e7-b05a-4561-bb93-69945ee01312 service nova] Releasing lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:42 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:26:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-changed-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:43 user nova-compute[75257]: DEBUG nova.compute.manager [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Refreshing instance network info cache due to event network-changed-cbd77511-3da8-4b8f-bd1c-bb5e9992f811. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:26:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] Acquiring lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:26:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] Acquired lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:26:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Refreshing network info cache for port cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:26:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updated VIF entry in instance network info cache for port cbd77511-3da8-4b8f-bd1c-bb5e9992f811. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:26:43 user nova-compute[75257]: DEBUG nova.network.neutron [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updating instance_info_cache with network_info: [{"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c67ac403-a477-41eb-ba7a-b8f844332f02 req-50b2f2eb-bfc3-4bad-b36e-bdef3dad6639 service nova] Releasing lock "refresh_cache-14f49370-77df-4e76-8e1d-4f89580315a4" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:26:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:26:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:26:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance spawned successfully.
Nov 14 02:26:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:26:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:26:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:44 user nova-compute[75257]: DEBUG nova.compute.manager [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] No waiting events found dispatching network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:26:44 user nova-compute[75257]: WARNING nova.compute.manager [req-2572f498-49f7-4d76-9f22-293b9b134117 req-d274adb9-71e2-47b9-9b7d-62766e22cecd service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received unexpected event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 02:26:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:26:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-feefea41-3c7a-444b-a7f1-a5673a7ba16c tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.527s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:26:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:26:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received event network-changed-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:26:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Refreshing instance network info cache due to event network-changed-a2de0a50-a398-4b3b-86a8-86137531ca29. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:26:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] Acquiring lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:26:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] Acquired lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:26:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Refreshing network info cache for port a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:26:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updated VIF entry in instance network info cache for port a2de0a50-a398-4b3b-86a8-86137531ca29. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:26:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating instance_info_cache with network_info: [{"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:26:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-32503b04-f944-409f-95bf-530f75c62e9f req-ca6479fb-43f1-41df-b324-08d7e6bdd8b3 service nova] Releasing lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:27:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:01 user nova-compute[75257]: DEBUG nova.objects.instance [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:27:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:02 user nova-compute[75257]: INFO nova.compute.manager [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attaching volume 2b1c6780-6738-4b1e-92c0-6a71a16a1dea to /dev/vdb
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.utils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bf9baa-81f5-403c-860b-6679976699f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9455bb29-fadd-49ce-9c76-82bda9f19957]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2023e2-87b3-4e36-bfb8-ce1ac075acc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7212f2b-a9cc-4bb6-825e-0bbe0d3dd6ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:27:02 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[698228e2-b18c-4dcf-bf4d-5099f2571c92]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.utils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating existing volume attachment record: 44c1585d-a2ed-4dc9-918a-b9704965e65b {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14f49370-77df-4e76-8e1d-4f89580315a4 is timed out.
Nov 14 02:27:02 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Successfully detached device vdb from instance 14f49370-77df-4e76-8e1d-4f89580315a4 from the live domain config.
Nov 14 02:27:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwzRqMtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:27:02 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a71e8a-0778-41cf-9a34-7885953823c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:27:02 user nova-compute[75257]: No targets found.
Nov 14 02:27:02 user nova-compute[75257]: iSNS:
Nov 14 02:27:02 user nova-compute[75257]: No targets found.
Nov 14 02:27:02 user nova-compute[75257]: STATIC:
Nov 14 02:27:02 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64
Nov 14 02:27:02 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:02 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:02 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad
Nov 14 02:27:02 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:02 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:02 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:27:02 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:02 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:02 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:27:02 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:02 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:02 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:27:02 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:02 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:02 user nova-compute[75257]: FIRMWARE:
Nov 14 02:27:02 user nova-compute[75257]: No targets found.
Nov 14 02:27:02 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:27:02 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:27:02 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f9c46a-c800-4114-ae82-196905690e57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c96527-858e-4943-9eb8-5e542dbaa6cd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:27:02 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:27:02 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:27:02 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:27:02 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:27:02 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:27:02 user nova-compute[75257]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 (non-flash)
Nov 14 02:27:02 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:27:02 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:27:02 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:27:02 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c3b3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8a4998-fb1a-4b46-a064-971d9058bbfd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa6a153-5224-48a6-97b1-a548cd2f7996]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6391670d-f1fa-4ea2-abd0-9d4da0104da1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4fb0db-5d35-4049-8357-81eee0d86da5]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcec4f85-f667-402c-96fd-90b47b3532d5]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd283a5-b480-457b-bfdb-d4a0753e9eeb]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64, portal: 172.16.0.220,3260]
Nov 14 02:27:02 user nova-compute[75257]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64, portal: 172.16.0.220,3260] successful.
Nov 14 02:27:02 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc412155-c035-4969-aa7f-9e1bc62a4e64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12aea8e-8bc7-4aa8-88e8-568dab7cc46a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] <== disconnect_volume: return (335ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:27:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:27:03 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'flavor' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:27:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7180ca57-e1e8-46e3-b7ce-17ec04316b14 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.741s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zCEWjmJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:27:06 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:27:06 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:27:06 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ee3c1e-4e6c-4e5f-8c15-e0eb2ab20ce1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:27:06 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[282fe29d-79f8-4e19-a7fc-18632f9dfab0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea] added
Nov 14 02:27:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f56b91-c5a5-4cdd-82a8-ca40f34c2f6f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8044f4f-e73b-42e4-8546-fc7795dfb028]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zCEWjmJG {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zCEWjmJG" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3106e76e-e722-443d-98b0-4934f070711c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zCEWjmJG'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17d7963-e293-4f1c-bfbb-bf862ddcf481]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6763a1-7522-4886-9cfb-ae1d393d716c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:27:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:27:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d84a56-de6f-44b0-becc-f910e512d8fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea, portal: 172.16.0.220,3260]
Nov 14 02:27:06 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea, portal: 172.16.0.220,3260] successful.
Nov 14 02:27:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4f0f8a-6df8-4d9c-9e3b-b1c15ea27017]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b715a20-37de-4861-a876-dfe0b1a95107]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea (non-flash)
Nov 14 02:27:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:27:06 user nova-compute[75257]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea (non-flash)
Nov 14 02:27:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a329e90-c9be-4264-9063-8c77dbc7557a]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:27:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zCEWjmJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23031633639393634', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031633639393634', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:27:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:27:07 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:27:07 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:27:07 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:27:07 user nova-compute[75257]:   <serial>2b1c6780-6738-4b1e-92c0-6a71a16a1dea</serial>
Nov 14 02:27:07 user nova-compute[75257]: </disk>
Nov 14 02:27:07 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:27:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updating instance_info_cache with network_info: [{"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:27:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:27:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:27:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:27:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:27:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No VIF found with MAC fa:16:3e:57:42:39, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:27:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-60ddf0e2-ddd8-488c-baa9-5d9c0d92590d tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.261s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:27:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:14 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:27:14 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7640MB free_disk=24.863239288330078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 14f49370-77df-4e76-8e1d-4f89580315a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance cbecb74e-b1af-404a-9fd6-050328413cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.014s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:27:15 user nova-compute[75257]: INFO nova.compute.claims [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Claim successful on node user
Nov 14 02:27:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:27:15 user nova-compute[75257]: INFO nova.compute.manager [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Detaching volume 2b1c6780-6738-4b1e-92c0-6a71a16a1dea
Nov 14 02:27:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:27:15 user nova-compute[75257]: INFO nova.virt.block_device [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attempting to driver detach volume 2b1c6780-6738-4b1e-92c0-6a71a16a1dea from mountpoint /dev/vdb
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Attempting to detach device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:27:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:27:15 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:27:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:27:15 user nova-compute[75257]:   <serial>2b1c6780-6738-4b1e-92c0-6a71a16a1dea</serial>
Nov 14 02:27:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:27:15 user nova-compute[75257]: </disk>
Nov 14 02:27:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:27:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully detached device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the persistent domain config.
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:27:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:27:15 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:27:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:27:15 user nova-compute[75257]:   <serial>2b1c6780-6738-4b1e-92c0-6a71a16a1dea</serial>
Nov 14 02:27:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:27:15 user nova-compute[75257]: </disk>
Nov 14 02:27:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.policy [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:27:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Creating image(s)
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "/opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "/opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.195s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk 1073741824" returned: 0 in 0.049s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Cannot resize image /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Ensure instance console log exists: /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Successfully created port: 89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Successfully updated port: 89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "refresh_cache-0e80866e-d70f-411d-a38b-78c2d1dbdc26" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquired lock "refresh_cache-0e80866e-d70f-411d-a38b-78c2d1dbdc26" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received event network-changed-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Refreshing instance network info cache due to event network-changed-89e73fae-e2e0-4e44-b3cd-633672b01625. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] Acquiring lock "refresh_cache-0e80866e-d70f-411d-a38b-78c2d1dbdc26" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:27:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.network.neutron [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Updating instance_info_cache with network_info: [{"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Releasing lock "refresh_cache-0e80866e-d70f-411d-a38b-78c2d1dbdc26" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Instance network_info: |[{"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] Acquired lock "refresh_cache-0e80866e-d70f-411d-a38b-78c2d1dbdc26" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.network.neutron [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Refreshing network info cache for port 89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Start _get_guest_xml network_info=[{"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:27:18 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:27:18 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1319516472',display_name='tempest-AttachVolumeNegativeTest-server-1319516472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1319516472',id=45,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJmvdP3IEeHXby/wt82RKAHJ1EuMOuRBONPnvf3oFImlzpnTYz4uBX5pkNhYHtvD+6sZM6d+0uGK7N5zYKnVRA+JfVJ1UjRQy4OBCbppf+/pHfrAvl8b7U9Qdi5muk0UQ==',key_name='tempest-keypair-460841353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-g7lm8h0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:27:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=0e80866e-d70f-411d-a38b-78c2d1dbdc26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:27,bridge_name='br-int',has_traffic_filtering=True,id=89e73fae-e2e0-4e44-b3cd-633672b01625,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e73fae-e2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e80866e-d70f-411d-a38b-78c2d1dbdc26 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:27:18 user nova-compute[75257]:   <uuid>0e80866e-d70f-411d-a38b-78c2d1dbdc26</uuid>
Nov 14 02:27:18 user nova-compute[75257]:   <name>instance-0000002d</name>
Nov 14 02:27:18 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:27:18 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:27:18 user nova-compute[75257]:   <metadata>
Nov 14 02:27:18 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:27:18 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:27:18 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1319516472</nova:name>
Nov 14 02:27:18 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:27:18</nova:creationTime>
Nov 14 02:27:18 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:27:18 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:27:18 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:27:18 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:27:18 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:27:18 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:27:18 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:27:18 user nova-compute[75257]:       <nova:owner>
Nov 14 02:27:18 user nova-compute[75257]:         <nova:user uuid="ca8f18684c914e9f93d16df39763743e">tempest-AttachVolumeNegativeTest-1714659318-project-member</nova:user>
Nov 14 02:27:18 user nova-compute[75257]:         <nova:project uuid="bb0268a9065e45f5978c20365956e369">tempest-AttachVolumeNegativeTest-1714659318</nova:project>
Nov 14 02:27:18 user nova-compute[75257]:       </nova:owner>
Nov 14 02:27:18 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:27:18 user nova-compute[75257]:       <nova:ports>
Nov 14 02:27:18 user nova-compute[75257]:         <nova:port uuid="89e73fae-e2e0-4e44-b3cd-633672b01625">
Nov 14 02:27:18 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 02:27:18 user nova-compute[75257]:         </nova:port>
Nov 14 02:27:18 user nova-compute[75257]:       </nova:ports>
Nov 14 02:27:18 user nova-compute[75257]:     </nova:instance>
Nov 14 02:27:18 user nova-compute[75257]:   </metadata>
Nov 14 02:27:18 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:27:18 user nova-compute[75257]:     <system>
Nov 14 02:27:18 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:27:18 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:27:18 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:27:18 user nova-compute[75257]:       <entry name="serial">0e80866e-d70f-411d-a38b-78c2d1dbdc26</entry>
Nov 14 02:27:18 user nova-compute[75257]:       <entry name="uuid">0e80866e-d70f-411d-a38b-78c2d1dbdc26</entry>
Nov 14 02:27:18 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:27:18 user nova-compute[75257]:     </system>
Nov 14 02:27:18 user nova-compute[75257]:   </sysinfo>
Nov 14 02:27:18 user nova-compute[75257]:   <os>
Nov 14 02:27:18 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:27:18 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:27:18 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:27:18 user nova-compute[75257]:   </os>
Nov 14 02:27:18 user nova-compute[75257]:   <features>
Nov 14 02:27:18 user nova-compute[75257]:     <acpi/>
Nov 14 02:27:18 user nova-compute[75257]:     <apic/>
Nov 14 02:27:18 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:27:18 user nova-compute[75257]:   </features>
Nov 14 02:27:18 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:27:18 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:27:18 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:27:18 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:27:18 user nova-compute[75257]:   </clock>
Nov 14 02:27:18 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:27:18 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:27:18 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:27:18 user nova-compute[75257]:   </cpu>
Nov 14 02:27:18 user nova-compute[75257]:   <devices>
Nov 14 02:27:18 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:27:18 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:27:18 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk"/>
Nov 14 02:27:18 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:27:18 user nova-compute[75257]:     </disk>
Nov 14 02:27:18 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:27:18 user nova-compute[75257]:       <mac address="fa:16:3e:9e:1f:27"/>
Nov 14 02:27:18 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:27:18 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:27:18 user nova-compute[75257]:       <target dev="tap89e73fae-e2"/>
Nov 14 02:27:18 user nova-compute[75257]:     </interface>
Nov 14 02:27:18 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:27:18 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/console.log" append="off"/>
Nov 14 02:27:18 user nova-compute[75257]:     </serial>
Nov 14 02:27:18 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:27:18 user nova-compute[75257]:     <video>
Nov 14 02:27:18 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:27:18 user nova-compute[75257]:     </video>
Nov 14 02:27:18 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:27:18 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:27:18 user nova-compute[75257]:     </rng>
Nov 14 02:27:18 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:27:18 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:27:18 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:27:18 user nova-compute[75257]:     </memballoon>
Nov 14 02:27:18 user nova-compute[75257]:   </devices>
Nov 14 02:27:18 user nova-compute[75257]: </domain>
Nov 14 02:27:18 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1319516472',display_name='tempest-AttachVolumeNegativeTest-server-1319516472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1319516472',id=45,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJmvdP3IEeHXby/wt82RKAHJ1EuMOuRBONPnvf3oFImlzpnTYz4uBX5pkNhYHtvD+6sZM6d+0uGK7N5zYKnVRA+JfVJ1UjRQy4OBCbppf+/pHfrAvl8b7U9Qdi5muk0UQ==',key_name='tempest-keypair-460841353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-g7lm8h0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:27:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=0e80866e-d70f-411d-a38b-78c2d1dbdc26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:27,bridge_name='br-int',has_traffic_filtering=True,id=89e73fae-e2e0-4e44-b3cd-633672b01625,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e73fae-e2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG os_vif [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:27,bridge_name='br-int',has_traffic_filtering=True,id=89e73fae-e2e0-4e44-b3cd-633672b01625,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e73fae-e2') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '490f0d92-5695-55f7-a994-d6ee8c1d4768', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89e73fae-e2, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89e73fae-e2, col_values=(('qos', UUID('28aa503e-4236-4e41-93e6-3ce081817e7e')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89e73fae-e2, col_values=(('external_ids', {'iface-id': '89e73fae-e2e0-4e44-b3cd-633672b01625', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:1f:27', 'vm-uuid': '0e80866e-d70f-411d-a38b-78c2d1dbdc26'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:18 user nova-compute[75257]: INFO os_vif [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1f:27,bridge_name='br-int',has_traffic_filtering=True,id=89e73fae-e2e0-4e44-b3cd-633672b01625,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e73fae-e2')
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No VIF found with MAC fa:16:3e:9e:1f:27, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.network.neutron [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Updated VIF entry in instance network info cache for port 89e73fae-e2e0-4e44-b3cd-633672b01625. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG nova.network.neutron [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Updating instance_info_cache with network_info: [{"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:27:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-016f963b-1a8e-4f0e-8511-e238c0ad213c req-f64cf1b2-57e9-4ba5-9bd5-dde0fff9a927 service nova] Releasing lock "refresh_cache-0e80866e-d70f-411d-a38b-78c2d1dbdc26" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received event network-vif-plugged-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] No waiting events found dispatching network-vif-plugged-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:27:19 user nova-compute[75257]: WARNING nova.compute.manager [req-341e4054-bf5d-444c-99e5-119209196259 req-7ce2332b-07b1-41b9-be34-2a8a3eb153f9 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received unexpected event network-vif-plugged-89e73fae-e2e0-4e44-b3cd-633672b01625 for instance with vm_state building and task_state spawning.
Nov 14 02:27:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:27:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Instance spawned successfully.
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:27:21 user nova-compute[75257]: INFO nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received event network-vif-plugged-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] No waiting events found dispatching network-vif-plugged-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:27:21 user nova-compute[75257]: WARNING nova.compute.manager [req-5b4d47ca-d144-4312-ba65-63d0b9802bac req-abb2cf72-7ce9-410c-b6aa-d6fd9e397e48 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received unexpected event network-vif-plugged-89e73fae-e2e0-4e44-b3cd-633672b01625 for instance with vm_state building and task_state spawning.
Nov 14 02:27:21 user nova-compute[75257]: INFO nova.compute.manager [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Took 6.89 seconds to build instance.
Nov 14 02:27:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4c4234-ce05-4049-b80d-31bfda47d447 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.990s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:32 user nova-compute[75257]: INFO nova.compute.manager [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Terminating instance
Nov 14 02:27:32 user nova-compute[75257]: DEBUG nova.compute.manager [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-unplugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-unplugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:27:32 user nova-compute[75257]: DEBUG nova.compute.manager [req-fb16ac06-6c20-4aeb-ab88-fdc8d4e16ceb req-1feddeb6-c1e7-4c30-8457-fa446f3732d9 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-unplugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:33 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Instance destroyed successfully.
Nov 14 02:27:33 user nova-compute[75257]: DEBUG nova.objects.instance [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'resources' on Instance uuid 14f49370-77df-4e76-8e1d-4f89580315a4 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-174000204',display_name='tempest-ServerRescueNegativeTestJSON-server-174000204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-174000204',id=36,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsFmFIPhOCkXP+VUy2d+niU2Ks7ncJCtipI380Z6fBMTn/cwQN6BjKiVmK+YzwFjPQUOcxjnbmNi7hQtgs8AMfiaBh5aypsW4p/ucVfVfpy5S1RpOX+1GnlAPNw74qPJQ==',key_name='tempest-keypair-34722916',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:23:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-taocfvzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=14f49370-77df-4e76-8e1d-4f89580315a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "address": "fa:16:3e:14:b4:b9", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd77511-3d", "ovs_interfaceid": "cbd77511-3da8-4b8f-bd1c-bb5e9992f811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=cbd77511-3da8-4b8f-bd1c-bb5e9992f811,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd77511-3d') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG os_vif [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=cbd77511-3da8-4b8f-bd1c-bb5e9992f811,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd77511-3d') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbd77511-3d, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74c3bffb-4fc0-43de-8b78-c2f4c735a9ac) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:33 user nova-compute[75257]: INFO os_vif [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:b4:b9,bridge_name='br-int',has_traffic_filtering=True,id=cbd77511-3da8-4b8f-bd1c-bb5e9992f811,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd77511-3d')
Nov 14 02:27:33 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Deleting instance files /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4_del
Nov 14 02:27:33 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Deletion of /opt/stack/data/nova/instances/14f49370-77df-4e76-8e1d-4f89580315a4_del complete
Nov 14 02:27:33 user nova-compute[75257]: INFO nova.compute.manager [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 14 02:27:33 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:27:33 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:27:34 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:27:34 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Took 0.80 seconds to deallocate network for instance.
Nov 14 02:27:34 user nova-compute[75257]: DEBUG nova.compute.manager [req-32621113-f81c-4697-8ebe-115902cfea85 req-4f802751-6ab4-49d4-9695-d64ebc69ed75 service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-deleted-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:27:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:34 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:27:34 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:27:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:34 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Deleted allocations for instance 14f49370-77df-4e76-8e1d-4f89580315a4
Nov 14 02:27:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-870b1049-dcbd-4faa-99a6-c147e849410f tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "14f49370-77df-4e76-8e1d-4f89580315a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.374s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:27:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] Acquiring lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:27:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:27:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] Lock "14f49370-77df-4e76-8e1d-4f89580315a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] No waiting events found dispatching network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:27:35 user nova-compute[75257]: WARNING nova.compute.manager [req-4f1afbad-054f-4f7e-a927-c9fe42739d53 req-1a83a940-8fba-4d24-bf81-87e060cfe18f service nova] [instance: 14f49370-77df-4e76-8e1d-4f89580315a4] Received unexpected event network-vif-plugged-cbd77511-3da8-4b8f-bd1c-bb5e9992f811 for instance with vm_state deleted and task_state None.
Nov 14 02:27:36 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 is timed out.
Nov 14 02:27:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully detached device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the live domain config.
Nov 14 02:27:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zCEWjmJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:27:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7095356b-0cbc-4a59-8f3b-b9865c4e6a06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:27:36 user nova-compute[75257]: No targets found.
Nov 14 02:27:36 user nova-compute[75257]: iSNS:
Nov 14 02:27:36 user nova-compute[75257]: No targets found.
Nov 14 02:27:36 user nova-compute[75257]: STATIC:
Nov 14 02:27:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad
Nov 14 02:27:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:27:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:27:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:27:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea
Nov 14 02:27:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:27:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:27:36 user nova-compute[75257]: FIRMWARE:
Nov 14 02:27:36 user nova-compute[75257]: No targets found.
Nov 14 02:27:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:27:36 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:27:36 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b020fc-ecb3-44c3-9e5b-f4dfbec735f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddb5e5d-542f-4f33-82f9-d4f151b485be]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:27:36 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:27:36 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:27:36 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:27:36 user nova-compute[75257]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea (non-flash)
Nov 14 02:27:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:27:36 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:27:36 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:27:36 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:27:36 user nova-compute[75257]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea (non-flash)
Nov 14 02:27:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c1c5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4c806a-34b8-455b-88a4-93c5ed3b6c1b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[304cd946-1a0f-4a98-963d-3f3f732631e6]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1f376a-d87e-45bb-96e1-503417c6f4a9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2824f8b-7464-4332-be49-84869a58fd23]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e119203-91f4-4b16-a895-35d952710332]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac63ea92-5e85-4471-8cfd-7d44730376d2]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea, portal: 172.16.0.220,3260]
Nov 14 02:27:36 user nova-compute[75257]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea, portal: 172.16.0.220,3260] successful.
Nov 14 02:27:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b1c6780-6738-4b1e-92c0-6a71a16a1dea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c9f82a-7f11-4ad8-a507-0f70f1c3294b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== disconnect_volume: return (330ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:27:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:27:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:27:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9f328baa-123a-410a-82c8-99ba90fe3f32 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:27:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:27:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:28:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:03 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:04 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:07 user nova-compute[75257]: INFO nova.compute.manager [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attaching volume 1a9fe585-47e9-453c-9851-1a3220ad21f0 to /dev/vdb
Nov 14 02:28:07 user nova-compute[75257]: DEBUG os_brick.utils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3df79b8-0df7-4fd7-93fa-f3b3cccf93a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ec6608-07b6-4eb7-ad2b-c583daba74ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2173865e-372e-4329-8bf5-ac0cc11d511a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d714549-27a0-47be-965d-4dbf3aa108ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:28:07 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:28:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a1c52f-e240-49a4-853b-f96f3ed36ba0]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG os_brick.utils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:28:07 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating existing volume attachment record: d117e44b-6ec1-44cf-acb7-e4718fbcf343 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:28:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updating instance_info_cache with network_info: [{"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:28:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-aef5782b-9a73-4309-a559-4a81d3c5ce2e" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:28:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:28:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received event network-changed-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Refreshing instance network info cache due to event network-changed-f2ab062e-af46-4816-8393-d3632a9607bd. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] Acquiring lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] Acquired lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG nova.network.neutron [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Refreshing network info cache for port f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG nova.network.neutron [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Updated VIF entry in instance network info cache for port f2ab062e-af46-4816-8393-d3632a9607bd. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG nova.network.neutron [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Updating instance_info_cache with network_info: [{"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:28:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6d74c714-640f-4efa-84c9-19da8990deef req-d62c6a4e-97bb-4a0c-ba43-d05361a90aa8 service nova] Releasing lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:28:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:28:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:28:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWoICNvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:28:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:28:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:28:12 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[161c815a-8b95-4d0c-a0c6-d7d55fea7624]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:28:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ca2fe8-29e4-4a29-86cc-f3110f3aba85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0] added
Nov 14 02:28:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc8faa3-2387-47f0-a21b-bd27366f5a74]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9038a7b0-7237-441e-bd29-4b8058916e1e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWoICNvb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qWoICNvb" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad3b903-19eb-4e09-992e-f3d12c773952]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qWoICNvb'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[284bdef8-93e9-4c9f-9a57-8066dbd2012f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde713de-9fce-49d1-a69c-4c7e748f494d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[379d3f79-69f4-4727-a959-8760ab588cc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0, portal: 172.16.0.220,3260]
Nov 14 02:28:12 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0, portal: 172.16.0.220,3260] successful.
Nov 14 02:28:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[95118953-a04d-4541-97ed-ce53a608c9de]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3106524-e7b5-4224-a3fe-5bada1ca2237]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:12 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[194ee0c1-b0bd-4ddd-bf0d-bd5cf72cc8fd]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWoICNvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:28:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26265643130356361', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265643130356361', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:28:13 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:28:13 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:28:13 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:28:13 user nova-compute[75257]:   <serial>1a9fe585-47e9-453c-9851-1a3220ad21f0</serial>
Nov 14 02:28:13 user nova-compute[75257]: </disk>
Nov 14 02:28:13 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:28:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No VIF found with MAC fa:16:3e:57:42:39, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-10b1ca88-6183-48f6-949b-9c365449727c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.367s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "b3976d80-daaa-4826-aeae-6178073670af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "b3976d80-daaa-4826-aeae-6178073670af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:15 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:28:15 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=7793MB free_disk=24.852516174316406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance cbecb74e-b1af-404a-9fd6-050328413cac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b3976d80-daaa-4826-aeae-6178073670af has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.353s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:28:15 user nova-compute[75257]: INFO nova.compute.claims [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Claim successful on node user
Nov 14 02:28:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:15 user nova-compute[75257]: INFO nova.compute.manager [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Detaching volume 1a9fe585-47e9-453c-9851-1a3220ad21f0
Nov 14 02:28:15 user nova-compute[75257]: INFO nova.virt.block_device [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attempting to driver detach volume 1a9fe585-47e9-453c-9851-1a3220ad21f0 from mountpoint /dev/vdb
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Attempting to detach device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:28:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:28:15 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:28:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:28:15 user nova-compute[75257]:   <serial>1a9fe585-47e9-453c-9851-1a3220ad21f0</serial>
Nov 14 02:28:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:28:15 user nova-compute[75257]: </disk>
Nov 14 02:28:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:28:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully detached device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the persistent domain config.
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:28:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:28:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:28:15 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:28:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:28:15 user nova-compute[75257]:   <serial>1a9fe585-47e9-453c-9851-1a3220ad21f0</serial>
Nov 14 02:28:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:28:15 user nova-compute[75257]: </disk>
Nov 14 02:28:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:28:16 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.policy [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61052c8663184644aa445e8b29a9d6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e49d1cf0a1c457ab943ffd360f1c3da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:28:16 user nova-compute[75257]: INFO nova.virt.block_device [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Booting with volume e28eaf8b-a06c-48e1-8242-dd6329cff46c at /dev/vda
Nov 14 02:28:16 user nova-compute[75257]: DEBUG os_brick.utils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eaefb0-b56d-4bac-ac71-b66fc412cb3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd82fe5e-3cef-47b8-96bb-6884fad647b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be229eb-840b-4352-9282-852f566853ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8479c3-22d8-4f15-acde-db6b6710f247]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:28:16 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed0253e-0838-458b-a475-c710c979a220]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG os_brick.utils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Updating existing volume attachment record: fa7de481-2b52-4898-a885-de37fb865513 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:16 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Successfully created port: bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:17 user nova-compute[75257]: INFO nova.compute.manager [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Detaching volume 02c3bf99-692c-40d2-92a2-99a680635aad
Nov 14 02:28:17 user nova-compute[75257]: INFO nova.virt.block_device [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Attempting to driver detach volume 02c3bf99-692c-40d2-92a2-99a680635aad from mountpoint /dev/vdc
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Attempting to detach device vdc from instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:28:17 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:28:17 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:28:17 user nova-compute[75257]:   <target dev="vdc" bus="virtio"/>
Nov 14 02:28:17 user nova-compute[75257]:   <serial>02c3bf99-692c-40d2-92a2-99a680635aad</serial>
Nov 14 02:28:17 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 02:28:17 user nova-compute[75257]: </disk>
Nov 14 02:28:17 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:28:17 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully detached device vdc from instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc from the persistent domain config.
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:28:17 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:28:17 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:28:17 user nova-compute[75257]:   <target dev="vdc" bus="virtio"/>
Nov 14 02:28:17 user nova-compute[75257]:   <serial>02c3bf99-692c-40d2-92a2-99a680635aad</serial>
Nov 14 02:28:17 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 02:28:17 user nova-compute[75257]: </disk>
Nov 14 02:28:17 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Successfully updated port: bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquired lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received event network-changed-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Refreshing instance network info cache due to event network-changed-bcd7a893-39ad-407d-84fb-0587f21fe9bc. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] Acquiring lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Updating instance_info_cache with network_info: [{"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Releasing lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Instance network_info: |[{"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] Acquired lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:28:17 user nova-compute[75257]: DEBUG nova.network.neutron [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Refreshing network info cache for port bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:28:18 user nova-compute[75257]: DEBUG nova.network.neutron [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Updated VIF entry in instance network info cache for port bcd7a893-39ad-407d-84fb-0587f21fe9bc. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:28:18 user nova-compute[75257]: DEBUG nova.network.neutron [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Updating instance_info_cache with network_info: [{"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:28:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c780e124-6458-4e53-a961-258d42cc01b9 req-23c3dde4-91a3-40d7-b5c3-789901d4daca service nova] Releasing lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "cbecb74e-b1af-404a-9fd6-050328413cac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:19 user nova-compute[75257]: INFO nova.compute.manager [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Terminating instance
Nov 14 02:28:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-unplugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-unplugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:28:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-deae7c0a-f118-4af1-b020-5afb58c1bd42 req-475516df-2f49-419f-a418-1196c145c6a1 service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-unplugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Instance destroyed successfully.
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'resources' on Instance uuid cbecb74e-b1af-404a-9fd6-050328413cac {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:22:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-893670019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-893670019',id=39,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-xoef4f6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:26:34Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=cbecb74e-b1af-404a-9fd6-050328413cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "109d45a8-89e1-43d8-9134-d29c37330e20", "address": "fa:16:3e:bd:51:7f", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap109d45a8-89", "ovs_interfaceid": "109d45a8-89e1-43d8-9134-d29c37330e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:51:7f,bridge_name='br-int',has_traffic_filtering=True,id=109d45a8-89e1-43d8-9134-d29c37330e20,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109d45a8-89') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_vif [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:51:7f,bridge_name='br-int',has_traffic_filtering=True,id=109d45a8-89e1-43d8-9134-d29c37330e20,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109d45a8-89') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap109d45a8-89, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c164f1e1-be76-4081-90ed-2440e31df4b3) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:20 user nova-compute[75257]: INFO os_vif [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:51:7f,bridge_name='br-int',has_traffic_filtering=True,id=109d45a8-89e1-43d8-9134-d29c37330e20,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap109d45a8-89')
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFpxJTIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:28:20 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f58597f-e510-43ac-aa90-72cc75a035b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:28:20 user nova-compute[75257]: No targets found.
Nov 14 02:28:20 user nova-compute[75257]: iSNS:
Nov 14 02:28:20 user nova-compute[75257]: No targets found.
Nov 14 02:28:20 user nova-compute[75257]: STATIC:
Nov 14 02:28:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad
Nov 14 02:28:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0
Nov 14 02:28:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0
Nov 14 02:28:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:28:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:28:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:20 user nova-compute[75257]: FIRMWARE:
Nov 14 02:28:20 user nova-compute[75257]: No targets found.
Nov 14 02:28:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:28:20 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:28:20 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0c022f-a6e1-4159-b0cf-0ad4739d5ff6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a831fb1-5fd3-445b-918d-6d67d6dd8867]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:20 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:28:20 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:20 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:20 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:20 user nova-compute[75257]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 (non-flash)
Nov 14 02:28:20 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:20 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:20 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a435d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0'): ({'sde'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Removing single pathed devices sde {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[780bcf2e-92b1-445d-8f96-6bc4887819e6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[659916ad-4b6c-47cc-ad2e-845f95577dcd]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flushing IO for device /dev/sde {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2726c5-5c23-4faa-b595-171d5b795017]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e13a9-4f63-4865-a290-d55e54f17c44]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO59c12343-18b70c8f71368e3d', '/dev/disk/by-id/scsi-23138623730633866', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_59c12343') {{(pid=85764) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 02:28:20 user nova-compute[75257]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO59c12343-18b70c8f71368e3d
Nov 14 02:28:20 user nova-compute[75257]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23138623730633866
Nov 14 02:28:20 user nova-compute[75257]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_59c12343
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a3ddb8-3d5c-4fcb-bf96-648c80813611]: (4, None) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a7a78-d838-450f-a870-620c04420231]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff36e0e2-c876-4f86-a633-1cd7023fb57c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0, portal: 172.16.0.220,3260]
Nov 14 02:28:20 user nova-compute[75257]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0, portal: 172.16.0.220,3260] successful.
Nov 14 02:28:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:515fd521-1fd4-4c68-aef5-5916661c86b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6a7c1a-39a1-48d8-bd32-7070777a5e2b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] <== disconnect_volume: return (352ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:28:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Deleting instance files /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac_del
Nov 14 02:28:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Deletion of /opt/stack/data/nova/instances/cbecb74e-b1af-404a-9fd6-050328413cac_del complete
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:28:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Creating image(s)
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Ensure instance console log exists: /opt/stack/data/nova/instances/b3976d80-daaa-4826-aeae-6178073670af/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Start _get_guest_xml network_info=[{"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fa7de481-2b52-4898-a885-de37fb865513', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlboMWEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b3976d80-daaa-4826-aeae-6178073670af', 'attached_at': '', 'detached_at': '', 'volume_id': 'e28eaf8b-a06c-48e1-8242-dd6329cff46c', 'serial': 'e28eaf8b-a06c-48e1-8242-dd6329cff46c'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:28:20 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:28:20 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlboMWEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:28:20 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:28:20 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:28:20 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: INFO nova.compute.manager [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b0a740-ce67-4c09-a9e7-880537446eef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:28:20 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a2abca-253a-40f1-8328-089d43302596]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c] added
Nov 14 02:28:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7870605f-38d1-47bc-8f2c-2d70e7fdeea3]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b3cd4f-f09e-4d79-a707-186c8757af55]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlboMWEm {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlboMWEm" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af205f1-53ba-46fa-910e-413d5c32bed7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlboMWEm'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a719865d-6509-4a1b-a75b-4d74a667f0bb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe06418-9910-4c1c-a243-7ead321049ec]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[594c34f4-a0fd-45ce-aeff-c3ac4263df4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c, portal: 172.16.0.220,3260]
Nov 14 02:28:21 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c, portal: 172.16.0.220,3260] successful.
Nov 14 02:28:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebc1b0e-0bdf-43d1-9ff4-7c2f947fdef0]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[40339e0f-4855-4391-b847-775243af3ea2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:28:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:21 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:28:21 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] HCTL ('36', '-', '-', 0) found on session 55 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef9d7d-1d7a-4a3a-b485-2caedc02653e]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlboMWEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:28:21 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:28:21 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Took 1.01 seconds to deallocate network for instance.
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] Acquiring lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] Lock "cbecb74e-b1af-404a-9fd6-050328413cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] No waiting events found dispatching network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:28:22 user nova-compute[75257]: WARNING nova.compute.manager [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received unexpected event network-vif-plugged-109d45a8-89e1-43d8-9134-d29c37330e20 for instance with vm_state active and task_state deleting.
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-4fa75fe2-958e-4cf8-876a-4223a129ea92 req-cd7c3685-de71-4800-b67a-c140ed012f0d service nova] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Received event network-vif-deleted-109d45a8-89e1-43d8-9134-d29c37330e20 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23639636233616663', 'path': '/dev/sde'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639636233616663', 'path': '/dev/sde'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-135866589',display_name='tempest-TestVolumeBootPattern-server-135866589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-135866589',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA==',key_name='tempest-TestVolumeBootPattern-1177175426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-xzvuz9qx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:28:16Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=b3976d80-daaa-4826-aeae-6178073670af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:9e,bridge_name='br-int',has_traffic_filtering=True,id=bcd7a893-39ad-407d-84fb-0587f21fe9bc,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd7a893-39') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'pci_devices' on Instance uuid b3976d80-daaa-4826-aeae-6178073670af {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:28:22 user nova-compute[75257]:   <uuid>b3976d80-daaa-4826-aeae-6178073670af</uuid>
Nov 14 02:28:22 user nova-compute[75257]:   <name>instance-0000002e</name>
Nov 14 02:28:22 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:28:22 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:28:22 user nova-compute[75257]:   <metadata>
Nov 14 02:28:22 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:28:22 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:28:22 user nova-compute[75257]:       <nova:name>tempest-TestVolumeBootPattern-server-135866589</nova:name>
Nov 14 02:28:22 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:28:20</nova:creationTime>
Nov 14 02:28:22 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:28:22 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:28:22 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:28:22 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:28:22 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:28:22 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:28:22 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:28:22 user nova-compute[75257]:       <nova:owner>
Nov 14 02:28:22 user nova-compute[75257]:         <nova:user uuid="61052c8663184644aa445e8b29a9d6ed">tempest-TestVolumeBootPattern-1633655156-project-member</nova:user>
Nov 14 02:28:22 user nova-compute[75257]:         <nova:project uuid="6e49d1cf0a1c457ab943ffd360f1c3da">tempest-TestVolumeBootPattern-1633655156</nova:project>
Nov 14 02:28:22 user nova-compute[75257]:       </nova:owner>
Nov 14 02:28:22 user nova-compute[75257]:       <nova:ports>
Nov 14 02:28:22 user nova-compute[75257]:         <nova:port uuid="bcd7a893-39ad-407d-84fb-0587f21fe9bc">
Nov 14 02:28:22 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 02:28:22 user nova-compute[75257]:         </nova:port>
Nov 14 02:28:22 user nova-compute[75257]:       </nova:ports>
Nov 14 02:28:22 user nova-compute[75257]:     </nova:instance>
Nov 14 02:28:22 user nova-compute[75257]:   </metadata>
Nov 14 02:28:22 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:28:22 user nova-compute[75257]:     <system>
Nov 14 02:28:22 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:28:22 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:28:22 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:28:22 user nova-compute[75257]:       <entry name="serial">b3976d80-daaa-4826-aeae-6178073670af</entry>
Nov 14 02:28:22 user nova-compute[75257]:       <entry name="uuid">b3976d80-daaa-4826-aeae-6178073670af</entry>
Nov 14 02:28:22 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:28:22 user nova-compute[75257]:     </system>
Nov 14 02:28:22 user nova-compute[75257]:   </sysinfo>
Nov 14 02:28:22 user nova-compute[75257]:   <os>
Nov 14 02:28:22 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:28:22 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:28:22 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:28:22 user nova-compute[75257]:   </os>
Nov 14 02:28:22 user nova-compute[75257]:   <features>
Nov 14 02:28:22 user nova-compute[75257]:     <acpi/>
Nov 14 02:28:22 user nova-compute[75257]:     <apic/>
Nov 14 02:28:22 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:28:22 user nova-compute[75257]:   </features>
Nov 14 02:28:22 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:28:22 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:28:22 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:28:22 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:28:22 user nova-compute[75257]:   </clock>
Nov 14 02:28:22 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:28:22 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:28:22 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:28:22 user nova-compute[75257]:   </cpu>
Nov 14 02:28:22 user nova-compute[75257]:   <devices>
Nov 14 02:28:22 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:28:22 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:28:22 user nova-compute[75257]:       <source dev="/dev/sde"/>
Nov 14 02:28:22 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:28:22 user nova-compute[75257]:       <serial>e28eaf8b-a06c-48e1-8242-dd6329cff46c</serial>
Nov 14 02:28:22 user nova-compute[75257]:     </disk>
Nov 14 02:28:22 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:28:22 user nova-compute[75257]:       <mac address="fa:16:3e:74:c7:9e"/>
Nov 14 02:28:22 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:28:22 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:28:22 user nova-compute[75257]:       <target dev="tapbcd7a893-39"/>
Nov 14 02:28:22 user nova-compute[75257]:     </interface>
Nov 14 02:28:22 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:28:22 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/b3976d80-daaa-4826-aeae-6178073670af/console.log" append="off"/>
Nov 14 02:28:22 user nova-compute[75257]:     </serial>
Nov 14 02:28:22 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:28:22 user nova-compute[75257]:     <video>
Nov 14 02:28:22 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:28:22 user nova-compute[75257]:     </video>
Nov 14 02:28:22 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:28:22 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:28:22 user nova-compute[75257]:     </rng>
Nov 14 02:28:22 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:28:22 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:28:22 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:28:22 user nova-compute[75257]:     </memballoon>
Nov 14 02:28:22 user nova-compute[75257]:   </devices>
Nov 14 02:28:22 user nova-compute[75257]: </domain>
Nov 14 02:28:22 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-135866589',display_name='tempest-TestVolumeBootPattern-server-135866589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-135866589',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA==',key_name='tempest-TestVolumeBootPattern-1177175426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-xzvuz9qx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:28:16Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=b3976d80-daaa-4826-aeae-6178073670af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:9e,bridge_name='br-int',has_traffic_filtering=True,id=bcd7a893-39ad-407d-84fb-0587f21fe9bc,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd7a893-39') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG os_vif [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:9e,bridge_name='br-int',has_traffic_filtering=True,id=bcd7a893-39ad-407d-84fb-0587f21fe9bc,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd7a893-39') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '632ea1fa-2f4c-5f02-914e-ff5e6cbf6607', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcd7a893-39, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcd7a893-39, col_values=(('qos', UUID('12562aaa-c618-4ed1-b8ca-baa6f4e1a2a8')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcd7a893-39, col_values=(('external_ids', {'iface-id': 'bcd7a893-39ad-407d-84fb-0587f21fe9bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:c7:9e', 'vm-uuid': 'b3976d80-daaa-4826-aeae-6178073670af'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:22 user nova-compute[75257]: INFO os_vif [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:9e,bridge_name='br-int',has_traffic_filtering=True,id=bcd7a893-39ad-407d-84fb-0587f21fe9bc,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd7a893-39')
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] No VIF found with MAC fa:16:3e:74:c7:9e, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:28:22 user nova-compute[75257]: INFO nova.compute.manager [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: cbecb74e-b1af-404a-9fd6-050328413cac] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 02:28:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:23 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:28:23 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:28:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:23 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Deleted allocations for instance cbecb74e-b1af-404a-9fd6-050328413cac
Nov 14 02:28:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2121af3b-0b42-4b07-bc24-a5f2e8dc3040 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "cbecb74e-b1af-404a-9fd6-050328413cac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.542s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received event network-vif-plugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] Acquiring lock "b3976d80-daaa-4826-aeae-6178073670af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:24 user nova-compute[75257]: DEBUG nova.compute.manager [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] No waiting events found dispatching network-vif-plugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:28:24 user nova-compute[75257]: WARNING nova.compute.manager [req-f72085e2-537d-4832-8ef9-8f8b5054bc4a req-bd4f8172-890e-4e15-bad1-14323c762d7d service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received unexpected event network-vif-plugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance with vm_state building and task_state spawning.
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:28:25 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b3976d80-daaa-4826-aeae-6178073670af] Instance spawned successfully.
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:28:25 user nova-compute[75257]: INFO nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 14 02:28:25 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:28:26 user nova-compute[75257]: INFO nova.compute.manager [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Took 10.75 seconds to build instance.
Nov 14 02:28:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7ac1bac1-fdd1-43b2-b044-cb49f7bf4b84 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "b3976d80-daaa-4826-aeae-6178073670af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.845s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received event network-vif-plugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] Acquiring lock "b3976d80-daaa-4826-aeae-6178073670af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:26 user nova-compute[75257]: DEBUG nova.compute.manager [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] No waiting events found dispatching network-vif-plugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:28:26 user nova-compute[75257]: WARNING nova.compute.manager [req-9e6d10b3-edfe-42a4-8477-4092f854c4e2 req-ef859564-eafe-4814-a115-2b8899f88507 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received unexpected event network-vif-plugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance with vm_state active and task_state None.
Nov 14 02:28:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:28 user nova-compute[75257]: INFO nova.compute.manager [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Terminating instance
Nov 14 02:28:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-unplugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] No waiting events found dispatching network-vif-unplugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG nova.compute.manager [req-80c0a0a2-9bd5-49a0-8a3f-e8ee91e824c5 req-4df937cc-fa86-49cc-8ffa-593e666a63d5 service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-unplugged-38baa7d3-e79c-48c0-a478-d946f09f9787 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Instance destroyed successfully.
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'resources' on Instance uuid aef5782b-9a73-4309-a559-4a81d3c5ce2e {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-439193571',display_name='tempest-ServerRescueNegativeTestJSON-server-439193571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-439193571',id=20,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:14:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-c10r056v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:14:25Z,user_data=None,user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=aef5782b-9a73-4309-a559-4a81d3c5ce2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "38baa7d3-e79c-48c0-a478-d946f09f9787", "address": "fa:16:3e:68:bd:de", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38baa7d3-e7", "ovs_interfaceid": "38baa7d3-e79c-48c0-a478-d946f09f9787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=38baa7d3-e79c-48c0-a478-d946f09f9787,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38baa7d3-e7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG os_vif [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=38baa7d3-e79c-48c0-a478-d946f09f9787,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38baa7d3-e7') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38baa7d3-e7, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48a0fb12-a3ac-4f0d-b624-edc55b69f2d2) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:29 user nova-compute[75257]: INFO os_vif [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:bd:de,bridge_name='br-int',has_traffic_filtering=True,id=38baa7d3-e79c-48c0-a478-d946f09f9787,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38baa7d3-e7')
Nov 14 02:28:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Deleting instance files /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e_del
Nov 14 02:28:29 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Deletion of /opt/stack/data/nova/instances/aef5782b-9a73-4309-a559-4a81d3c5ce2e_del complete
Nov 14 02:28:29 user nova-compute[75257]: INFO nova.compute.manager [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 14 02:28:29 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:28:29 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Took 0.47 seconds to deallocate network for instance.
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-deleted-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:29 user nova-compute[75257]: INFO nova.compute.manager [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Neutron deleted interface 38baa7d3-e79c-48c0-a478-d946f09f9787; detaching it from the instance and deleting it from the info cache
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.network.neutron [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.compute.manager [req-7fde103c-1760-465a-9c54-ca511479ebed req-0337e29e-c7c7-44f1-9571-26d60419609f service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Detach interface failed, port_id=38baa7d3-e79c-48c0-a478-d946f09f9787, reason: Instance aef5782b-9a73-4309-a559-4a81d3c5ce2e could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:28:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:30 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Deleted allocations for instance aef5782b-9a73-4309-a559-4a81d3c5ce2e
Nov 14 02:28:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b0e8f6d8-cc66-43f0-8f23-86625c7c0186 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.660s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:28:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] Acquiring lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:28:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:28:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] Lock "aef5782b-9a73-4309-a559-4a81d3c5ce2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:30 user nova-compute[75257]: DEBUG nova.compute.manager [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] No waiting events found dispatching network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:28:30 user nova-compute[75257]: WARNING nova.compute.manager [req-27da45e0-04a5-4783-81ba-28174c361d7c req-54e4e340-ca4f-49a1-a8b8-a0b952b5992d service nova] [instance: aef5782b-9a73-4309-a559-4a81d3c5ce2e] Received unexpected event network-vif-plugged-38baa7d3-e79c-48c0-a478-d946f09f9787 for instance with vm_state deleted and task_state None.
Nov 14 02:28:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:36 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 is timed out.
Nov 14 02:28:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully detached device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the live domain config.
Nov 14 02:28:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qWoICNvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:28:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1f4ec9-d371-4cbb-9457-f079f436a3b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:28:36 user nova-compute[75257]: No targets found.
Nov 14 02:28:36 user nova-compute[75257]: iSNS:
Nov 14 02:28:36 user nova-compute[75257]: No targets found.
Nov 14 02:28:36 user nova-compute[75257]: STATIC:
Nov 14 02:28:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c
Nov 14 02:28:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad
Nov 14 02:28:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0
Nov 14 02:28:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:28:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:28:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:36 user nova-compute[75257]: FIRMWARE:
Nov 14 02:28:36 user nova-compute[75257]: No targets found.
Nov 14 02:28:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:28:36 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:28:36 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad67008-0ee8-41cf-8397-b9b364b4f174]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c88aca-1f81-4d1f-920b-f4a10469bcac]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:36 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:36 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:36 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:36 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:28:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:36 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:36 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:36 user nova-compute[75257]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 (non-flash)
Nov 14 02:28:36 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:28:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a435eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7261f9fb-797f-424d-8931-b360eae8e080]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c33ff-b68d-4bb4-91ef-20c69b33b996]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b6e780-f79d-407f-a82e-271d549b0deb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd1602-991b-463a-85d4-95a6c633ecaa]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad3abcd-21f0-4e0a-a95a-c40a07b0f234]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7efce66-11cb-4d5b-84e1-8b3ebfb43d72]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0, portal: 172.16.0.220,3260]
Nov 14 02:28:36 user nova-compute[75257]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0, portal: 172.16.0.220,3260] successful.
Nov 14 02:28:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a9fe585-47e9-453c-9851-1a3220ad21f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefb92fb-480f-496d-aacf-f49dc3c3fa83]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== disconnect_volume: return (302ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:28:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4b7c27bd-cb69-487f-a19b-ff3292b5d69b tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc is timed out.
Nov 14 02:28:37 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully detached device vdc from instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc from the live domain config.
Nov 14 02:28:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOvTHFnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:28:37 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e34bb6d-5940-432c-9662-88b5cb52b321]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:28:37 user nova-compute[75257]: No targets found.
Nov 14 02:28:37 user nova-compute[75257]: iSNS:
Nov 14 02:28:37 user nova-compute[75257]: No targets found.
Nov 14 02:28:37 user nova-compute[75257]: STATIC:
Nov 14 02:28:37 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c
Nov 14 02:28:37 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:37 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:37 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad
Nov 14 02:28:37 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:37 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:37 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:28:37 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:37 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:37 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:28:37 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:28:37 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:28:37 user nova-compute[75257]: FIRMWARE:
Nov 14 02:28:37 user nova-compute[75257]: No targets found.
Nov 14 02:28:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:28:37 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:28:37 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe457b1-1dfb-496b-9875-68091aa513dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7f9027-9574-446e-b11d-038c43d6ec3c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:37 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:37 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:37 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:28:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:28:37 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:28:37 user nova-compute[75257]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad (non-flash)
Nov 14 02:28:37 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:28:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a41ad360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad'): ({'sdf'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Removing single pathed devices sdf {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fad14e8-8b03-4a34-b8a7-66b765a1c216]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6947e68c-b857-4b99-8fee-da8db6b62dc9]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flushing IO for device /dev/sdf {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:28:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e78295-d5a2-4ab3-80f0-80035a4717b2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bac354-f733-4c83-ac30-79005a7bb76d]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fab678-afde-4792-94f9-39e41de90a87]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b55d4a-14e1-45de-8051-326ddd647a16]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad, portal: 172.16.0.220,3260]
Nov 14 02:28:38 user nova-compute[75257]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad, portal: 172.16.0.220,3260] successful.
Nov 14 02:28:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c3bf99-692c-40d2-92a2-99a680635aad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6eaac-d44c-47ff-bf8a-5cc3f60c1c51]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] <== disconnect_volume: return (301ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'flavor' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:28:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b22341a4-29a3-4156-a943-6325736bb1e7 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.678s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:28:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:28:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:29:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received event network-changed-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Refreshing instance network info cache due to event network-changed-89e73fae-e2e0-4e44-b3cd-633672b01625. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:29:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] Acquiring lock "refresh_cache-0e80866e-d70f-411d-a38b-78c2d1dbdc26" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:29:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] Acquired lock "refresh_cache-0e80866e-d70f-411d-a38b-78c2d1dbdc26" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:29:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Refreshing network info cache for port 89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:29:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Updated VIF entry in instance network info cache for port 89e73fae-e2e0-4e44-b3cd-633672b01625. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:29:06 user nova-compute[75257]: DEBUG nova.network.neutron [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Updating instance_info_cache with network_info: [{"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:29:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3b87c841-634b-435c-b3f2-5a7068c6a77d req-28d14844-2bc2-4cf0-92f6-373c48508a65 service nova] Releasing lock "refresh_cache-0e80866e-d70f-411d-a38b-78c2d1dbdc26" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:29:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:07 user nova-compute[75257]: INFO nova.compute.manager [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Terminating instance
Nov 14 02:29:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'flavor' on Instance uuid 0e80866e-d70f-411d-a38b-78c2d1dbdc26 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:07 user nova-compute[75257]: INFO nova.compute.manager [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Attaching volume e4a46da4-16d6-477b-bec4-7e0cb6b6d792 to /dev/vdb
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-unplugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] No waiting events found dispatching network-vif-unplugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-46321267-be18-4b37-8634-9249bbf96e7c req-cf74a49a-28aa-42ad-a5dd-e8396a9dd5b0 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-unplugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG os_brick.utils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8196d1bc-14d2-40e0-9b56-4f82bab39147]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[41082566-38ea-4400-b260-3deed7b6f636]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef12683-3020-4f6a-a29b-23a8a7ccb2a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf2f894-35d7-4baf-9918-41539c539db1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:08 user nova-compute[75257]: INFO nova.compute.manager [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attaching volume 4cf1b41c-f8ef-41ba-8525-8bb005e04658 to /dev/vdb
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:29:08 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[478271c0-b6dd-4376-9502-4b8eb4cbb4e2]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.utils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Updating existing volume attachment record: 94ed49b8-b793-4e3c-8958-36981f42e75d {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.utils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb2732e-77bc-434f-b8a1-f35d21840c62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1064724-9722-47f7-9e0a-257b66980053]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ab6c2f-dec8-4ce4-8935-831d3b2e02fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[813bd854-839d-41c9-b541-2e389969318b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:29:08 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db5c0ec-1f69-46de-bc1b-35b924d8bd77]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_brick.utils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating existing volume attachment record: aadb7079-e3d9-4adc-93ee-589c6c901e7e {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:29:08 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Instance destroyed successfully.
Nov 14 02:29:08 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'resources' on Instance uuid f3c72a5a-0bce-4ebe-b2da-61f7f08155cc {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432527132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432527132',id=38,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDtiB1Q/29INzS1Awe+SrgWEvNOe4OsR9c2+ytcV4I9qNI9t4UTFZ3vYkj4sjWDTElkVGfSPjrpMOIeYBmbQit22H7RXOnJXqzHe8TWNNfea+Locbv+beA3JPiwlKqB5A==',key_name='tempest-keypair-1542235845',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-xuuad11y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:26:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=f3c72a5a-0bce-4ebe-b2da-61f7f08155cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "address": "fa:16:3e:b3:1c:83", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7b2500-ad", "ovs_interfaceid": "cd7b2500-ad09-43fc-ad92-8338dc32fcbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG os_vif [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd7b2500-ad, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=526799af-da74-4a5c-94b8-08af227d3b30) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:29:08 user nova-compute[75257]: INFO os_vif [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:1c:83,bridge_name='br-int',has_traffic_filtering=True,id=cd7b2500-ad09-43fc-ad92-8338dc32fcbe,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7b2500-ad')
Nov 14 02:29:08 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Deleting instance files /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc_del
Nov 14 02:29:08 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Deletion of /opt/stack/data/nova/instances/f3c72a5a-0bce-4ebe-b2da-61f7f08155cc_del complete
Nov 14 02:29:08 user nova-compute[75257]: INFO nova.compute.manager [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:29:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:29:09 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Took 0.88 seconds to deallocate network for instance.
Nov 14 02:29:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-0621685b-500d-46e2-aa76-4468dd33ce6b req-eb8c5a98-224c-4004-9a71-ba7e24f0b0fd service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-deleted-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:09 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Deleted allocations for instance f3c72a5a-0bce-4ebe-b2da-61f7f08155cc
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6e4ffd2e-315f-4b1d-9a2a-2eec666a60ed tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.299s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] Acquiring lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] Lock "f3c72a5a-0bce-4ebe-b2da-61f7f08155cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] No waiting events found dispatching network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:29:09 user nova-compute[75257]: WARNING nova.compute.manager [req-fd8ea230-fe03-4f21-8259-2fd425edf049 req-71f7928a-da05-487d-b658-634ded8dd449 service nova] [instance: f3c72a5a-0bce-4ebe-b2da-61f7f08155cc] Received unexpected event network-vif-plugged-cd7b2500-ad09-43fc-ad92-8338dc32fcbe for instance with vm_state deleted and task_state None.
Nov 14 02:29:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updating instance_info_cache with network_info: [{"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-ab639b27-9978-41c7-b93d-e18bd4af09d7" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:10 user nova-compute[75257]: INFO nova.compute.manager [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Terminating instance
Nov 14 02:29:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received event network-vif-unplugged-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] Acquiring lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] No waiting events found dispatching network-vif-unplugged-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-5b1bd548-38f5-4093-9301-84aaa57fd90c req-f2b29b41-2938-4a70-8786-798e1ffa157d service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received event network-vif-unplugged-9f182a18-791f-4fba-b4b9-787664194dd7 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:11 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Instance destroyed successfully.
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.objects.instance [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'resources' on Instance uuid ba9ecc12-fe4e-4124-8f4c-2160cd08337b {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:19:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1009716805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1009716805',id=33,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:19:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-ob75vpqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:21:45Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=ba9ecc12-fe4e-4124-8f4c-2160cd08337b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "9f182a18-791f-4fba-b4b9-787664194dd7", "address": "fa:16:3e:18:d1:85", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f182a18-79", "ovs_interfaceid": "9f182a18-791f-4fba-b4b9-787664194dd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=9f182a18-791f-4fba-b4b9-787664194dd7,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f182a18-79') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG os_vif [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=9f182a18-791f-4fba-b4b9-787664194dd7,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f182a18-79') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f182a18-79, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81c44d04-2316-49d3-9b64-09012d428a19) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:11 user nova-compute[75257]: INFO os_vif [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=9f182a18-791f-4fba-b4b9-787664194dd7,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f182a18-79')
Nov 14 02:29:11 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Deleting instance files /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b_del
Nov 14 02:29:11 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Deletion of /opt/stack/data/nova/instances/ba9ecc12-fe4e-4124-8f4c-2160cd08337b_del complete
Nov 14 02:29:11 user nova-compute[75257]: INFO nova.compute.manager [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 14 02:29:11 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:29:11 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Took 0.45 seconds to deallocate network for instance.
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.compute.manager [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received event network-vif-deleted-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:11 user nova-compute[75257]: INFO nova.compute.manager [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Neutron deleted interface 9f182a18-791f-4fba-b4b9-787664194dd7; detaching it from the instance and deleting it from the info cache
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.compute.manager [req-59381f92-3761-4015-9e6c-990b2b39e14b req-37e44585-ea5b-42a1-92bc-c117420212ad service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Detach interface failed, port_id=9f182a18-791f-4fba-b4b9-787664194dd7, reason: Instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:29:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:12 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Deleted allocations for instance ba9ecc12-fe4e-4124-8f4c-2160cd08337b
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTwIHiOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:29:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:29:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:29:12 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-2cd6f408-2bf0-4c2c-9b5d-f368be93d36c tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.908s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7d94df-e8d8-4be1-9589-bb6ee109547b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:29:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6303c4f-39be-4700-b6e6-000a46ff357d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792] added
Nov 14 02:29:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc2148-b34d-4181-a451-80fb4e4b77da]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9098f9a-fa07-471a-90d2-41aa7c060464]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTwIHiOx {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTwIHiOx" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efccafc-a8c1-4125-b9df-acf7f4aafcd2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aTwIHiOx'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a15fff-1cb0-470a-9381-fd220adf23cd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa1ebc6-fca5-432d-ab8f-d6c521bd5f83]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30323e2-a34c-4fe6-83b3-883409c2e60e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792, portal: 172.16.0.220,3260]
Nov 14 02:29:12 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792, portal: 172.16.0.220,3260] successful.
Nov 14 02:29:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef28b1f8-5fcd-47ce-965e-d9f517976df6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76a634b-aba4-41c8-a462-a1ff6017184c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)
Nov 14 02:29:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:12 user nova-compute[75257]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)
Nov 14 02:29:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buomDLdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:29:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0645eaca-df5c-4db4-8d08-ca5f8f1db94b]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received event network-vif-plugged-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] Acquiring lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] Lock "ba9ecc12-fe4e-4124-8f4c-2160cd08337b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:12 user nova-compute[75257]: DEBUG nova.compute.manager [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] No waiting events found dispatching network-vif-plugged-9f182a18-791f-4fba-b4b9-787664194dd7 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:29:12 user nova-compute[75257]: WARNING nova.compute.manager [req-24170ae7-3208-40ab-8c64-0b0b77332723 req-a3f4d189-04b1-4375-b7c9-f2c956a6f6ee service nova] [instance: ba9ecc12-fe4e-4124-8f4c-2160cd08337b] Received unexpected event network-vif-plugged-9f182a18-791f-4fba-b4b9-787664194dd7 for instance with vm_state deleted and task_state None.
Nov 14 02:29:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTwIHiOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23633383433326534', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633383433326534', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.062s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:29:13 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:29:13 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:29:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8200MB free_disk=25.030784606933594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'flavor' on Instance uuid 0e80866e-d70f-411d-a38b-78c2d1dbdc26 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[793d2b3b-7ebc-4add-9062-7542915fde58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:29:13 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d51c85-0537-4b45-afe0-83cd94ffddec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658] added
Nov 14 02:29:13 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:29:13 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:29:13 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:29:13 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:29:13 user nova-compute[75257]:   <serial>e4a46da4-16d6-477b-bec4-7e0cb6b6d792</serial>
Nov 14 02:29:13 user nova-compute[75257]: </disk>
Nov 14 02:29:13 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[df93d30c-1213-4cb9-97ee-40c5d06e88cd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb562da5-1bc7-48fb-876c-c589de385acb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buomDLdl {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance b3976d80-daaa-4826-aeae-6178073670af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buomDLdl" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b62c4d4-de79-485b-aad3-998d57030b47]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'buomDLdl'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e69822-227b-4dac-9b3c-bdd66381246e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[002792e4-afa9-4c6e-99a2-a0226b892b2d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:13 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:13 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:13 user nova-compute[75257]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)
Nov 14 02:29:13 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:13 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:13 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:13 user nova-compute[75257]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)
Nov 14 02:29:13 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:29:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c76ca00-5885-45ce-b050-71328cd81505]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658, portal: 172.16.0.220,3260]
Nov 14 02:29:14 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658, portal: 172.16.0.220,3260] successful.
Nov 14 02:29:14 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[500006a3-630b-44b7-a772-35d31ab59790]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca026ff8-94c0-46fb-bf0b-b9a4b897a391]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:14 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:14 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:14 user nova-compute[75257]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)
Nov 14 02:29:14 user nova-compute[75257]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 (non-flash)
Nov 14 02:29:14 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:14 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:14 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:14 user nova-compute[75257]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)
Nov 14 02:29:14 user nova-compute[75257]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 (non-flash)
Nov 14 02:29:14 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] HCTL ('37', '-', '-', 0) found on session 57 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b266d4-d276-4ed7-9891-de41e319b7e6]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Searching for a device in session 57 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buomDLdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No VIF found with MAC fa:16:3e:9e:1f:27, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:29:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d45e118b-b1ee-4fb5-96ce-303759821c5c tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.560s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== connect_volume: return (2421ms) {'type': 'block', 'scsi_wwn': '23731623030366161', 'path': '/dev/sdf'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731623030366161', 'path': '/dev/sdf'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:29:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:29:15 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:29:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:29:15 user nova-compute[75257]:   <serial>4cf1b41c-f8ef-41ba-8525-8bb005e04658</serial>
Nov 14 02:29:15 user nova-compute[75257]: </disk>
Nov 14 02:29:15 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No VIF found with MAC fa:16:3e:57:42:39, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7882f387-ecc5-46de-9978-dca75857b17c tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.673s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:15 user nova-compute[75257]: INFO nova.compute.manager [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Detaching volume e4a46da4-16d6-477b-bec4-7e0cb6b6d792
Nov 14 02:29:15 user nova-compute[75257]: INFO nova.virt.block_device [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Attempting to driver detach volume e4a46da4-16d6-477b-bec4-7e0cb6b6d792 from mountpoint /dev/vdb
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Attempting to detach device vdb from instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:29:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:29:15 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:29:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:29:15 user nova-compute[75257]:   <serial>e4a46da4-16d6-477b-bec4-7e0cb6b6d792</serial>
Nov 14 02:29:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:29:15 user nova-compute[75257]: </disk>
Nov 14 02:29:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:29:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully detached device vdb from instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 from the persistent domain config.
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:29:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:29:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:29:15 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:29:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:29:15 user nova-compute[75257]:   <serial>e4a46da4-16d6-477b-bec4-7e0cb6b6d792</serial>
Nov 14 02:29:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:29:15 user nova-compute[75257]: </disk>
Nov 14 02:29:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:29:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:29:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:18 user nova-compute[75257]: INFO nova.compute.manager [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Detaching volume 4cf1b41c-f8ef-41ba-8525-8bb005e04658
Nov 14 02:29:18 user nova-compute[75257]: INFO nova.virt.block_device [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attempting to driver detach volume 4cf1b41c-f8ef-41ba-8525-8bb005e04658 from mountpoint /dev/vdb
Nov 14 02:29:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Attempting to detach device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:29:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:29:18 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:29:18 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:29:18 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:29:18 user nova-compute[75257]:   <serial>4cf1b41c-f8ef-41ba-8525-8bb005e04658</serial>
Nov 14 02:29:18 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:29:18 user nova-compute[75257]: </disk>
Nov 14 02:29:18 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:29:18 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully detached device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the persistent domain config.
Nov 14 02:29:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:29:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:29:18 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:29:18 user nova-compute[75257]:   <source dev="/dev/sdf"/>
Nov 14 02:29:18 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:29:18 user nova-compute[75257]:   <serial>4cf1b41c-f8ef-41ba-8525-8bb005e04658</serial>
Nov 14 02:29:18 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:29:18 user nova-compute[75257]: </disk>
Nov 14 02:29:18 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:29:18 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:19 user nova-compute[75257]: INFO nova.compute.manager [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Terminating instance
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-unplugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-unplugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-3597bebb-3bcc-4a8b-8cfe-34c4d8c3bfeb req-c18b2002-77d0-401a-8ba4-19388ae715bb service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-unplugged-775872ee-1599-4358-9d11-07252d3855ce for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Instance destroyed successfully.
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.objects.instance [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lazy-loading 'resources' on Instance uuid 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1099099117',display_name='tempest-ServerRescueNegativeTestJSON-server-1099099117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1099099117',id=19,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:17:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ac9795cbe748fc8079de4bb8234cd3',ramdisk_id='',reservation_id='r-ls19w9yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-66746497',owner_user_name='tempest-ServerRescueNegativeTestJSON-66746497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:19:08Z,user_data=None,user_id='a5f8a4942cb54c9aa5377e6d2df1aa7b',uuid=91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converting VIF {"id": "775872ee-1599-4358-9d11-07252d3855ce", "address": "fa:16:3e:16:e4:fb", "network": {"id": "49124b4f-3521-43c8-bda4-701f450c6b7d", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2104642228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ac9795cbe748fc8079de4bb8234cd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775872ee-15", "ovs_interfaceid": "775872ee-1599-4358-9d11-07252d3855ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:e4:fb,bridge_name='br-int',has_traffic_filtering=True,id=775872ee-1599-4358-9d11-07252d3855ce,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775872ee-15') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG os_vif [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:e4:fb,bridge_name='br-int',has_traffic_filtering=True,id=775872ee-1599-4358-9d11-07252d3855ce,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775872ee-15') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap775872ee-15, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adacda9c-9865-42bd-a597-034aa8d85531) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:19 user nova-compute[75257]: INFO os_vif [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:e4:fb,bridge_name='br-int',has_traffic_filtering=True,id=775872ee-1599-4358-9d11-07252d3855ce,network=Network(49124b4f-3521-43c8-bda4-701f450c6b7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775872ee-15')
Nov 14 02:29:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Deleting instance files /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef_del
Nov 14 02:29:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Deletion of /opt/stack/data/nova/instances/91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef_del complete
Nov 14 02:29:19 user nova-compute[75257]: INFO nova.compute.manager [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 02:29:19 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:29:19 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:29:20 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:29:20 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Took 0.44 seconds to deallocate network for instance.
Nov 14 02:29:20 user nova-compute[75257]: DEBUG nova.compute.manager [req-da3b11f1-a590-4ec0-9d37-9a569b7d87c8 req-da4f516c-d5c8-4073-8b24-e4ef40f77646 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-deleted-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:20 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:29:20 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:29:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:20 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Deleted allocations for instance 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef
Nov 14 02:29:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-5e29b816-28fa-474b-ace8-80e25e8a3a15 tempest-ServerRescueNegativeTestJSON-66746497 tempest-ServerRescueNegativeTestJSON-66746497-project-member] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:29:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] Acquiring lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:29:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:29:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] Lock "91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] No waiting events found dispatching network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:29:21 user nova-compute[75257]: WARNING nova.compute.manager [req-034ae34c-46ff-4ef5-98ca-152f19168f8e req-18bc6291-befd-42d9-870d-963668579d07 service nova] [instance: 91ae8e8f-23ae-42c5-8d2b-0f0c8f3046ef] Received unexpected event network-vif-plugged-775872ee-1599-4358-9d11-07252d3855ce for instance with vm_state deleted and task_state None.
Nov 14 02:29:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:29:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:29:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:29:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:29:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:29:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:29:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:36 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 is timed out.
Nov 14 02:29:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully detached device vdb from instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26 from the live domain config.
Nov 14 02:29:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTwIHiOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:29:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91ea0cd-fab8-4082-8607-18a9b72008d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:29:36 user nova-compute[75257]: No targets found.
Nov 14 02:29:36 user nova-compute[75257]: iSNS:
Nov 14 02:29:36 user nova-compute[75257]: No targets found.
Nov 14 02:29:36 user nova-compute[75257]: STATIC:
Nov 14 02:29:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658
Nov 14 02:29:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:29:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:29:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c
Nov 14 02:29:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:29:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:29:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792
Nov 14 02:29:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:29:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:29:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:29:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:29:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:29:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:29:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:29:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:29:36 user nova-compute[75257]: FIRMWARE:
Nov 14 02:29:36 user nova-compute[75257]: No targets found.
Nov 14 02:29:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:29:36 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:29:36 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3fa20f-7fa4-4f50-8b1a-996c2a00a7b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db0d415-3c3e-4699-85f7-d180bcaef4bd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:36 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:36 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:36 user nova-compute[75257]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)
Nov 14 02:29:36 user nova-compute[75257]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 (non-flash)
Nov 14 02:29:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:36 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:36 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:36 user nova-compute[75257]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 (non-flash)
Nov 14 02:29:36 user nova-compute[75257]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 (non-flash)
Nov 14 02:29:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c1bdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4ba1c6-1e3b-4ae2-a56d-9b68476f6297]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82a05e5-7190-4f54-a833-489945bd2b86]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3293bb-e64e-4cfc-9336-e4fea74840a4]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d2fa0e-9354-4220-804e-2701b2b9ef21]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[280ae701-595b-4138-a542-3b1fcdfd48b7]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2de7fb1-ae85-4f41-b5b8-0d2b3de0d9ee]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792, portal: 172.16.0.220,3260]
Nov 14 02:29:36 user nova-compute[75257]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792, portal: 172.16.0.220,3260] successful.
Nov 14 02:29:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a46da4-16d6-477b-bec4-7e0cb6b6d792 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f86eca-46d6-425a-a950-009cda981078]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] <== disconnect_volume: return (321ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:29:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:29:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'flavor' on Instance uuid 0e80866e-d70f-411d-a38b-78c2d1dbdc26 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:29:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-0716212b-51a7-4726-89f4-b5ea62436443 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:38 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 is timed out.
Nov 14 02:29:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully detached device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the live domain config.
Nov 14 02:29:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buomDLdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:29:38 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[451fc178-77a4-430b-b17a-1ff023124d7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:29:38 user nova-compute[75257]: No targets found.
Nov 14 02:29:38 user nova-compute[75257]: iSNS:
Nov 14 02:29:38 user nova-compute[75257]: No targets found.
Nov 14 02:29:38 user nova-compute[75257]: STATIC:
Nov 14 02:29:38 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658
Nov 14 02:29:38 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:29:38 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:29:38 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c
Nov 14 02:29:38 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:29:38 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:29:38 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:29:38 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:29:38 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:29:38 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:29:38 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:29:38 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:29:38 user nova-compute[75257]: FIRMWARE:
Nov 14 02:29:38 user nova-compute[75257]: No targets found.
Nov 14 02:29:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:29:38 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:29:38 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfefcea1-8138-4984-b377-594290ce233a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e070af9-cd2c-423c-bb97-53c42a1a2222]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:38 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:38 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:38 user nova-compute[75257]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 (non-flash)
Nov 14 02:29:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:29:38 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:29:38 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:29:38 user nova-compute[75257]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 (non-flash)
Nov 14 02:29:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c2d8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658'): ({'sdf'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Removing single pathed devices sdf {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a2041-4130-4a68-b7e1-f74e318dc003]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1ba1f7-84e9-4ae1-99c6-1d3ffcc84473]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Flushing IO for device /dev/sdf {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b6cbb2-37aa-45a8-ba44-554af0f7b78c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe0e716-97bd-4ed7-ad75-4774a5808557]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] SCSI volumes sdf have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9f9753-aada-4732-8ea7-f59d2a132441]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1f7bdc-37c0-4b67-9427-b3a864cffdf2]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658, portal: 172.16.0.220,3260]
Nov 14 02:29:38 user nova-compute[75257]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658, portal: 172.16.0.220,3260] successful.
Nov 14 02:29:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf1b41c-f8ef-41ba-8525-8bb005e04658 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1170521e-405d-46c3-a7b6-00ad84a981cf]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== disconnect_volume: return (339ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:29:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:29:39 user nova-compute[75257]: DEBUG nova.objects.instance [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:29:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c7b9047e-3a9f-4f49-a253-c3c929c9c591 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.593s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:29:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:29:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:29:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:29:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:29:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:29:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:29:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:29:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:29:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:29:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:01 user nova-compute[75257]: INFO nova.compute.manager [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Terminating instance
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:30:01 user nova-compute[75257]: INFO nova.compute.claims [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Claim successful on node user
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-unplugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-unplugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-57336ea0-4490-4e8f-9012-e956863e6d4d req-02812a2e-2e0f-4832-907b-e1757ccd3d19 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-unplugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:30:01 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.policy [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd50e0e5a436243f2a91c012a4996185c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c246fb95dcc49fd910ec526b1977fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:30:01 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Creating image(s)
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:01 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Instance destroyed successfully.
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.objects.instance [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'resources' on Instance uuid ab639b27-9978-41c7-b93d-e18bd4af09d7 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1905828341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1905828341',id=23,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:16:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-iv0rdupj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:18:02Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=ab639b27-9978-41c7-b93d-e18bd4af09d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "address": "fa:16:3e:5c:f6:3b", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88e98b9f-7f", "ovs_interfaceid": "88e98b9f-7f03-4af9-a6a6-e512673f84ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:f6:3b,bridge_name='br-int',has_traffic_filtering=True,id=88e98b9f-7f03-4af9-a6a6-e512673f84ae,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e98b9f-7f') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_vif [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:f6:3b,bridge_name='br-int',has_traffic_filtering=True,id=88e98b9f-7f03-4af9-a6a6-e512673f84ae,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e98b9f-7f') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88e98b9f-7f, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a146a8cb-a046-4e8b-adf8-a7218c5e919b) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:01 user nova-compute[75257]: INFO os_vif [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:f6:3b,bridge_name='br-int',has_traffic_filtering=True,id=88e98b9f-7f03-4af9-a6a6-e512673f84ae,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88e98b9f-7f')
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kTuxVNGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:30:01 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4b4dc5-ec97-4335-9a34-fbb1aad14504]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:30:01 user nova-compute[75257]: No targets found.
Nov 14 02:30:01 user nova-compute[75257]: iSNS:
Nov 14 02:30:01 user nova-compute[75257]: No targets found.
Nov 14 02:30:01 user nova-compute[75257]: STATIC:
Nov 14 02:30:01 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c
Nov 14 02:30:01 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:30:01 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:30:01 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:30:01 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:30:01 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:30:01 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d
Nov 14 02:30:01 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:30:01 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:30:01 user nova-compute[75257]: FIRMWARE:
Nov 14 02:30:01 user nova-compute[75257]: No targets found.
Nov 14 02:30:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:30:01 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:30:01 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[24670e7c-2f45-4e4d-9f72-a154cb762176]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f974d522-7fc4-4842-b17a-63711566d8a7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:30:01 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:01 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:30:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d (non-flash)
Nov 14 02:30:01 user nova-compute[75257]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:01 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:30:01 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c2d8c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d'): ({'sdd'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Removing single pathed devices sdd {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:30:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4450729-f106-43de-8b7f-0d466abc0246]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e878a8-3dde-4316-8a24-0d7161ba86e2]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Flushing IO for device /dev/sdd {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk 1073741824" returned: 0 in 0.051s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f99c7-d5e4-4686-9da8-26998c0f3158]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9714aee2-ed46-4264-a9ff-dce3f9e3d40c]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] SCSI volumes sdd have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[901c62b1-3b0c-41cd-8f2e-e0349639f686]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b832a1af-8123-4552-8802-05f651665e8d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d, portal: 172.16.0.220,3260]
Nov 14 02:30:02 user nova-compute[75257]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d, portal: 172.16.0.220,3260] successful.
Nov 14 02:30:02 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef89d81b-e5bf-41ab-a543-9a59db55976d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2cbb19-536b-419b-ab17-0105282e22dc]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Successfully created port: b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] <== disconnect_volume: return (432ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:30:02 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Deleting instance files /opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7_del
Nov 14 02:30:02 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Deletion of /opt/stack/data/nova/instances/ab639b27-9978-41c7-b93d-e18bd4af09d7_del complete
Nov 14 02:30:02 user nova-compute[75257]: INFO nova.compute.manager [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Cannot resize image /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Ensure instance console log exists: /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-deleted-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:02 user nova-compute[75257]: INFO nova.compute.manager [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Neutron deleted interface 88e98b9f-7f03-4af9-a6a6-e512673f84ae; detaching it from the instance and deleting it from the info cache
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:02 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Took 0.47 seconds to deallocate network for instance.
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-27a27a4b-5dd3-4d29-888b-d2584abc599a req-e7722c61-33d5-4ff0-b659-5d80ad1852e5 service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Detach interface failed, port_id=88e98b9f-7f03-4af9-a6a6-e512673f84ae, reason: Instance ab639b27-9978-41c7-b93d-e18bd4af09d7 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Successfully updated port: b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquired lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:30:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-changed-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Refreshing instance network info cache due to event network-changed-b59d72e7-1b00-4b19-a592-0b96e73ce3e3. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] Acquiring lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] Acquiring lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] No waiting events found dispatching network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:03 user nova-compute[75257]: WARNING nova.compute.manager [req-b6251490-daf8-440c-9ea8-630575d37171 req-78736fbf-c07f-434b-a298-21a0018035fc service nova] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Received unexpected event network-vif-plugged-88e98b9f-7f03-4af9-a6a6-e512673f84ae for instance with vm_state active and task_state deleting.
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Releasing lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance network_info: |[{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] Acquired lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Refreshing network info cache for port b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Start _get_guest_xml network_info=[{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:30:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:30:03 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1660326635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1660326635',id=47,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE91lh5tHRqpYXNObplNRCy+a795EP7uZgnVuDAfVsDnERaiLFlI1bE+Gi73FXjtQk5G/hWsJT6013+Zi2k8RWa470GvxW1pXuyWjGkKEApcXI2Ty4VUOS+0NMGPshoXyg==',key_name='tempest-keypair-1707904333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-imf2fync',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:30:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=d4b4d4a3-50f6-4381-92ab-01ce730ecb54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.objects.instance [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'pci_devices' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:30:03 user nova-compute[75257]:   <uuid>d4b4d4a3-50f6-4381-92ab-01ce730ecb54</uuid>
Nov 14 02:30:03 user nova-compute[75257]:   <name>instance-0000002f</name>
Nov 14 02:30:03 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:30:03 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:30:03 user nova-compute[75257]:   <metadata>
Nov 14 02:30:03 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:30:03 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:30:03 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1660326635</nova:name>
Nov 14 02:30:03 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:30:03</nova:creationTime>
Nov 14 02:30:03 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:30:03 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:30:03 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:30:03 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:30:03 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:30:03 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:30:03 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:30:03 user nova-compute[75257]:       <nova:owner>
Nov 14 02:30:03 user nova-compute[75257]:         <nova:user uuid="d50e0e5a436243f2a91c012a4996185c">tempest-AttachVolumeShelveTestJSON-1725343669-project-member</nova:user>
Nov 14 02:30:03 user nova-compute[75257]:         <nova:project uuid="4c246fb95dcc49fd910ec526b1977fc8">tempest-AttachVolumeShelveTestJSON-1725343669</nova:project>
Nov 14 02:30:03 user nova-compute[75257]:       </nova:owner>
Nov 14 02:30:03 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:30:03 user nova-compute[75257]:       <nova:ports>
Nov 14 02:30:03 user nova-compute[75257]:         <nova:port uuid="b59d72e7-1b00-4b19-a592-0b96e73ce3e3">
Nov 14 02:30:03 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 02:30:03 user nova-compute[75257]:         </nova:port>
Nov 14 02:30:03 user nova-compute[75257]:       </nova:ports>
Nov 14 02:30:03 user nova-compute[75257]:     </nova:instance>
Nov 14 02:30:03 user nova-compute[75257]:   </metadata>
Nov 14 02:30:03 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:30:03 user nova-compute[75257]:     <system>
Nov 14 02:30:03 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:30:03 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:30:03 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:30:03 user nova-compute[75257]:       <entry name="serial">d4b4d4a3-50f6-4381-92ab-01ce730ecb54</entry>
Nov 14 02:30:03 user nova-compute[75257]:       <entry name="uuid">d4b4d4a3-50f6-4381-92ab-01ce730ecb54</entry>
Nov 14 02:30:03 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:30:03 user nova-compute[75257]:     </system>
Nov 14 02:30:03 user nova-compute[75257]:   </sysinfo>
Nov 14 02:30:03 user nova-compute[75257]:   <os>
Nov 14 02:30:03 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:30:03 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:30:03 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:30:03 user nova-compute[75257]:   </os>
Nov 14 02:30:03 user nova-compute[75257]:   <features>
Nov 14 02:30:03 user nova-compute[75257]:     <acpi/>
Nov 14 02:30:03 user nova-compute[75257]:     <apic/>
Nov 14 02:30:03 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:30:03 user nova-compute[75257]:   </features>
Nov 14 02:30:03 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:30:03 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:30:03 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:30:03 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:30:03 user nova-compute[75257]:   </clock>
Nov 14 02:30:03 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:30:03 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:30:03 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:30:03 user nova-compute[75257]:   </cpu>
Nov 14 02:30:03 user nova-compute[75257]:   <devices>
Nov 14 02:30:03 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:30:03 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:30:03 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk"/>
Nov 14 02:30:03 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:30:03 user nova-compute[75257]:     </disk>
Nov 14 02:30:03 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:30:03 user nova-compute[75257]:       <mac address="fa:16:3e:bc:61:11"/>
Nov 14 02:30:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:30:03 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:30:03 user nova-compute[75257]:       <target dev="tapb59d72e7-1b"/>
Nov 14 02:30:03 user nova-compute[75257]:     </interface>
Nov 14 02:30:03 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:30:03 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/console.log" append="off"/>
Nov 14 02:30:03 user nova-compute[75257]:     </serial>
Nov 14 02:30:03 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:30:03 user nova-compute[75257]:     <video>
Nov 14 02:30:03 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:30:03 user nova-compute[75257]:     </video>
Nov 14 02:30:03 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:30:03 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:30:03 user nova-compute[75257]:     </rng>
Nov 14 02:30:03 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:30:03 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:30:03 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:30:03 user nova-compute[75257]:     </memballoon>
Nov 14 02:30:03 user nova-compute[75257]:   </devices>
Nov 14 02:30:03 user nova-compute[75257]: </domain>
Nov 14 02:30:03 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1660326635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1660326635',id=47,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE91lh5tHRqpYXNObplNRCy+a795EP7uZgnVuDAfVsDnERaiLFlI1bE+Gi73FXjtQk5G/hWsJT6013+Zi2k8RWa470GvxW1pXuyWjGkKEApcXI2Ty4VUOS+0NMGPshoXyg==',key_name='tempest-keypair-1707904333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-imf2fync',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:30:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=d4b4d4a3-50f6-4381-92ab-01ce730ecb54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG os_vif [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfe13714-bf4c-5593-879a-072ea3386e36', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb59d72e7-1b, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb59d72e7-1b, col_values=(('qos', UUID('454a0886-5145-4ee6-bcad-e3882ea7f17a')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb59d72e7-1b, col_values=(('external_ids', {'iface-id': 'b59d72e7-1b00-4b19-a592-0b96e73ce3e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:61:11', 'vm-uuid': 'd4b4d4a3-50f6-4381-92ab-01ce730ecb54'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:03 user nova-compute[75257]: INFO os_vif [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b')
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] No VIF found with MAC fa:16:3e:bc:61:11, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:30:03 user nova-compute[75257]: INFO nova.compute.manager [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: ab639b27-9978-41c7-b93d-e18bd4af09d7] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updated VIF entry in instance network info cache for port b59d72e7-1b00-4b19-a592-0b96e73ce3e3. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f672d740-a018-4d16-b990-3f6d0a8a0104 req-ebfe6ff0-63ef-48f2-a7a7-bbdf8b8573ff service nova] Releasing lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:30:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:03 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Deleted allocations for instance ab639b27-9978-41c7-b93d-e18bd4af09d7
Nov 14 02:30:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3375c2b5-c53b-4a34-8e75-ad9b96377d70 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "ab639b27-9978-41c7-b93d-e18bd4af09d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] No waiting events found dispatching network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:05 user nova-compute[75257]: WARNING nova.compute.manager [req-22f7dc2d-008b-42d9-b28e-5a39d59b632e req-a3ca96c6-9809-49b9-89dc-04c5ccdad876 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received unexpected event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance with vm_state building and task_state spawning.
Nov 14 02:30:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:06 user nova-compute[75257]: INFO nova.compute.manager [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Terminating instance
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received event network-vif-unplugged-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] No waiting events found dispatching network-vif-unplugged-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-994d795c-a264-41f5-bb60-4baf3230f9e0 req-753797dd-3b44-4f6b-aef7-b737c52a24a8 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received event network-vif-unplugged-89e73fae-e2e0-4e44-b3cd-633672b01625 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Instance destroyed successfully.
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.objects.instance [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'resources' on Instance uuid 0e80866e-d70f-411d-a38b-78c2d1dbdc26 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1319516472',display_name='tempest-AttachVolumeNegativeTest-server-1319516472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1319516472',id=45,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJmvdP3IEeHXby/wt82RKAHJ1EuMOuRBONPnvf3oFImlzpnTYz4uBX5pkNhYHtvD+6sZM6d+0uGK7N5zYKnVRA+JfVJ1UjRQy4OBCbppf+/pHfrAvl8b7U9Qdi5muk0UQ==',key_name='tempest-keypair-460841353',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:27:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-g7lm8h0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:27:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=0e80866e-d70f-411d-a38b-78c2d1dbdc26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "89e73fae-e2e0-4e44-b3cd-633672b01625", "address": "fa:16:3e:9e:1f:27", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e73fae-e2", "ovs_interfaceid": "89e73fae-e2e0-4e44-b3cd-633672b01625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:1f:27,bridge_name='br-int',has_traffic_filtering=True,id=89e73fae-e2e0-4e44-b3cd-633672b01625,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e73fae-e2') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG os_vif [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:1f:27,bridge_name='br-int',has_traffic_filtering=True,id=89e73fae-e2e0-4e44-b3cd-633672b01625,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e73fae-e2') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89e73fae-e2, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28aa503e-4236-4e41-93e6-3ce081817e7e) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:30:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance spawned successfully.
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:30:06 user nova-compute[75257]: INFO os_vif [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:1f:27,bridge_name='br-int',has_traffic_filtering=True,id=89e73fae-e2e0-4e44-b3cd-633672b01625,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e73fae-e2')
Nov 14 02:30:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Deleting instance files /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26_del
Nov 14 02:30:06 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Deletion of /opt/stack/data/nova/instances/0e80866e-d70f-411d-a38b-78c2d1dbdc26_del complete
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:30:06 user nova-compute[75257]: INFO nova.compute.manager [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 02:30:06 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:30:06 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:30:07 user nova-compute[75257]: INFO nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 14 02:30:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:30:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:07 user nova-compute[75257]: DEBUG nova.compute.manager [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] No waiting events found dispatching network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:07 user nova-compute[75257]: WARNING nova.compute.manager [req-c1c65eec-1c10-4c72-b4e2-efb54ab185b7 req-16a10b7f-574d-4e71-ba79-16a2d3699a15 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received unexpected event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance with vm_state building and task_state spawning.
Nov 14 02:30:07 user nova-compute[75257]: INFO nova.compute.manager [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Took 6.05 seconds to build instance.
Nov 14 02:30:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-888b7253-308c-499f-808b-61f6667dba49 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.154s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:07 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:07 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Took 0.82 seconds to deallocate network for instance.
Nov 14 02:30:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:08 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Deleted allocations for instance 0e80866e-d70f-411d-a38b-78c2d1dbdc26
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received event network-changed-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Refreshing instance network info cache due to event network-changed-bcd7a893-39ad-407d-84fb-0587f21fe9bc. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] Acquiring lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] Acquired lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.network.neutron [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Refreshing network info cache for port bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-9163a562-88cb-4148-a86e-b19a240baf93 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "b3976d80-daaa-4826-aeae-6178073670af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "b3976d80-daaa-4826-aeae-6178073670af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "b3976d80-daaa-4826-aeae-6178073670af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:08 user nova-compute[75257]: INFO nova.compute.manager [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Terminating instance
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received event network-vif-plugged-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Acquiring lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Lock "0e80866e-d70f-411d-a38b-78c2d1dbdc26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] No waiting events found dispatching network-vif-plugged-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:08 user nova-compute[75257]: WARNING nova.compute.manager [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received unexpected event network-vif-plugged-89e73fae-e2e0-4e44-b3cd-633672b01625 for instance with vm_state deleted and task_state None.
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received event network-changed-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Refreshing instance network info cache due to event network-changed-bcd7a893-39ad-407d-84fb-0587f21fe9bc. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Acquiring lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Updated VIF entry in instance network info cache for port bcd7a893-39ad-407d-84fb-0587f21fe9bc. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Updating instance_info_cache with network_info: [{"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0a8d1d0d-9171-4120-9fc2-d42224107589 req-d6b247ad-1cd5-4494-959c-72aa0b45a550 service nova] Releasing lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Acquired lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Refreshing network info cache for port bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:30:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: b3976d80-daaa-4826-aeae-6178073670af] Instance destroyed successfully.
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'resources' on Instance uuid b3976d80-daaa-4826-aeae-6178073670af {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-135866589',display_name='tempest-TestVolumeBootPattern-server-135866589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-135866589',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA==',key_name='tempest-TestVolumeBootPattern-1177175426',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:28:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-xzvuz9qx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:28:26Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=b3976d80-daaa-4826-aeae-6178073670af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:9e,bridge_name='br-int',has_traffic_filtering=True,id=bcd7a893-39ad-407d-84fb-0587f21fe9bc,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd7a893-39') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_vif [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:9e,bridge_name='br-int',has_traffic_filtering=True,id=bcd7a893-39ad-407d-84fb-0587f21fe9bc,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd7a893-39') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcd7a893-39, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12562aaa-c618-4ed1-b8ca-baa6f4e1a2a8) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:09 user nova-compute[75257]: INFO os_vif [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c7:9e,bridge_name='br-int',has_traffic_filtering=True,id=bcd7a893-39ad-407d-84fb-0587f21fe9bc,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcd7a893-39')
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlboMWEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:30:09 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd71d05-da24-4322-9453-a7ffa1062044]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:30:09 user nova-compute[75257]: No targets found.
Nov 14 02:30:09 user nova-compute[75257]: iSNS:
Nov 14 02:30:09 user nova-compute[75257]: No targets found.
Nov 14 02:30:09 user nova-compute[75257]: STATIC:
Nov 14 02:30:09 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c
Nov 14 02:30:09 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:30:09 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:30:09 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:30:09 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:30:09 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:30:09 user nova-compute[75257]: FIRMWARE:
Nov 14 02:30:09 user nova-compute[75257]: No targets found.
Nov 14 02:30:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:30:09 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:30:09 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a73484-4392-4e90-afd3-fa566a624340]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e2f945-9179-4b17-bc46-6938477818ee]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:09 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:30:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:09 user nova-compute[75257]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c (non-flash)
Nov 14 02:30:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a435f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c'): ({'sde'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Removing single pathed devices sde {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[29747094-eca5-496e-b9c3-a55d65b6c5e9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf626a2a-54cf-4450-a393-52eaefb7eb37]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flushing IO for device /dev/sde {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db2218f-c20b-4590-b05e-9de0ad04f178]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7141dfc3-9cc7-41b8-b364-9a58d3242a34]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] SCSI volumes sde have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_194f2957', '/dev/disk/by-id/scsi-23639636233616663', '/dev/disk/by-id/scsi-1SCST_BIO194f2957-69cb3afc7dec4844') {{(pid=85764) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e849e-2510-4203-94fe-4d9377294d22]: (4, None) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5d003f-3b7f-4f84-af41-7682c3a7a35b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[51009d3e-54c9-4b67-87cb-5127d770ee8d]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c, portal: 172.16.0.220,3260]
Nov 14 02:30:09 user nova-compute[75257]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c, portal: 172.16.0.220,3260] successful.
Nov 14 02:30:09 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28eaf8b-a06c-48e1-8242-dd6329cff46c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[055f1d5f-1a5b-4d09-ba00-3692823ae128]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== disconnect_volume: return (392ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:30:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Deleting instance files /opt/stack/data/nova/instances/b3976d80-daaa-4826-aeae-6178073670af_del
Nov 14 02:30:09 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Deletion of /opt/stack/data/nova/instances/b3976d80-daaa-4826-aeae-6178073670af_del complete
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Updated VIF entry in instance network info cache for port bcd7a893-39ad-407d-84fb-0587f21fe9bc. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.network.neutron [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Updating instance_info_cache with network_info: [{"id": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "address": "fa:16:3e:74:c7:9e", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcd7a893-39", "ovs_interfaceid": "bcd7a893-39ad-407d-84fb-0587f21fe9bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] Releasing lock "refresh_cache-b3976d80-daaa-4826-aeae-6178073670af" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.compute.manager [req-2ff98c59-1246-41d4-b314-a2cc95d753d6 req-b157f060-7f09-4446-b5ae-b2955aad4937 service nova] [instance: 0e80866e-d70f-411d-a38b-78c2d1dbdc26] Received event network-vif-deleted-89e73fae-e2e0-4e44-b3cd-633672b01625 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:09 user nova-compute[75257]: INFO nova.compute.manager [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 14 02:30:09 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: b3976d80-daaa-4826-aeae-6178073670af] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:30:09 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: b3976d80-daaa-4826-aeae-6178073670af] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: b3976d80-daaa-4826-aeae-6178073670af] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:10 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: b3976d80-daaa-4826-aeae-6178073670af] Took 0.51 seconds to deallocate network for instance.
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:10 user nova-compute[75257]: INFO nova.compute.manager [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attaching volume 98f3b222-e2d4-4f42-a1f1-e450ac6d8713 to /dev/vdb
Nov 14 02:30:10 user nova-compute[75257]: DEBUG os_brick.utils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received event network-vif-unplugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Acquiring lock "b3976d80-daaa-4826-aeae-6178073670af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] No waiting events found dispatching network-vif-unplugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received event network-vif-unplugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received event network-vif-plugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Acquiring lock "b3976d80-daaa-4826-aeae-6178073670af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] Lock "b3976d80-daaa-4826-aeae-6178073670af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] No waiting events found dispatching network-vif-plugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:10 user nova-compute[75257]: WARNING nova.compute.manager [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received unexpected event network-vif-plugged-bcd7a893-39ad-407d-84fb-0587f21fe9bc for instance with vm_state active and task_state deleting.
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-36b7853e-719e-43c9-a03a-f13621770201 req-98a9fcf1-21d2-4651-8f6c-91c34b4e652f service nova] [instance: b3976d80-daaa-4826-aeae-6178073670af] Received event network-vif-deleted-bcd7a893-39ad-407d-84fb-0587f21fe9bc {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[712fc2ae-2b07-4fef-87a4-039ca3849136]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e816bf6-c054-4438-ba07-87cbea237905]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[683d6a34-b39c-4443-a071-680c81458aa8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef8ff9b-915c-4b48-8a78-1ff68019d42c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:30:10 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d652f1-7bc2-4a67-825b-d3b1d0a5e607]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG os_brick.utils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating existing volume attachment record: e2355ab2-b7ab-4fc1-ad1f-33cc526b9b56 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:30:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:30:11 user nova-compute[75257]: INFO nova.compute.manager [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: b3976d80-daaa-4826-aeae-6178073670af] Took 0.88 seconds to detach 1 volumes for instance.
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:11 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Deleted allocations for instance b3976d80-daaa-4826-aeae-6178073670af
Nov 14 02:30:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating instance_info_cache with network_info: [{"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e3eacfd0-ad25-4c3c-880a-eed1932eafcb tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "b3976d80-daaa-4826-aeae-6178073670af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.168s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:30:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:30:13 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=25.067710876464844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:30:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fduiABbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:30:15 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:30:15 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:30:15 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[248ca829-0e8a-4603-9df5-6ba9b51bc873]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:30:15 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[30276c1b-ca24-43e2-80f7-4fa111ab0605]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713] added
Nov 14 02:30:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dbba05-b530-40c2-820e-0b3e915377ef]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[594fe53e-285b-4be8-846e-f570070f78a5]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fduiABbn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fduiABbn" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5f0820-4f99-488e-96a1-2b8d72cd5406]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fduiABbn'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c8b2a0-0fb1-4780-a32d-b1a7d90d3d3f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[45210a44-1fe0-49c5-9426-6d88bab0ee9a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87b768b-440a-4991-979a-bdfa1294be4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713, portal: 172.16.0.220,3260]
Nov 14 02:30:15 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713, portal: 172.16.0.220,3260] successful.
Nov 14 02:30:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[393859ca-833f-4178-b995-12eee143fe9a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[68210a4a-de40-40c4-901b-ced1defd32d5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:15 user nova-compute[75257]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 (non-flash)
Nov 14 02:30:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:15 user nova-compute[75257]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 (non-flash)
Nov 14 02:30:15 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d708c527-b076-46c3-bbd0-d33029a42a82]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:30:15 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fduiABbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:30:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:30:16 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23339333233613365', 'path': '/dev/sdc'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:30:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339333233613365', 'path': '/dev/sdc'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:30:16 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:30:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:30:16 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:30:16 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:30:16 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:30:16 user nova-compute[75257]:   <serial>98f3b222-e2d4-4f42-a1f1-e450ac6d8713</serial>
Nov 14 02:30:16 user nova-compute[75257]: </disk>
Nov 14 02:30:16 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:30:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:30:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:30:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] No VIF found with MAC fa:16:3e:57:42:39, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:30:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8c2df3c7-f684-4eec-b8cb-04342aec8451 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.651s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:19 user nova-compute[75257]: INFO nova.compute.manager [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Detaching volume 98f3b222-e2d4-4f42-a1f1-e450ac6d8713
Nov 14 02:30:19 user nova-compute[75257]: INFO nova.virt.block_device [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Attempting to driver detach volume 98f3b222-e2d4-4f42-a1f1-e450ac6d8713 from mountpoint /dev/vdb
Nov 14 02:30:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Attempting to detach device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:30:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:30:19 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:30:19 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:30:19 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:30:19 user nova-compute[75257]:   <serial>98f3b222-e2d4-4f42-a1f1-e450ac6d8713</serial>
Nov 14 02:30:19 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:30:19 user nova-compute[75257]: </disk>
Nov 14 02:30:19 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:30:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully detached device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the persistent domain config.
Nov 14 02:30:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:30:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:30:19 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:30:19 user nova-compute[75257]:   <source dev="/dev/sdc"/>
Nov 14 02:30:19 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:30:19 user nova-compute[75257]:   <serial>98f3b222-e2d4-4f42-a1f1-e450ac6d8713</serial>
Nov 14 02:30:19 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:30:19 user nova-compute[75257]: </disk>
Nov 14 02:30:19 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:30:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:30:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:30:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:40 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 is timed out.
Nov 14 02:30:40 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully detached device vdb from instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 from the live domain config.
Nov 14 02:30:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fduiABbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:30:40 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d40ca9-ef55-43db-8888-34441192ecf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:30:40 user nova-compute[75257]: No targets found.
Nov 14 02:30:40 user nova-compute[75257]: iSNS:
Nov 14 02:30:40 user nova-compute[75257]: No targets found.
Nov 14 02:30:40 user nova-compute[75257]: STATIC:
Nov 14 02:30:40 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713
Nov 14 02:30:40 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:30:40 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:30:40 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:30:40 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:30:40 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:30:40 user nova-compute[75257]: FIRMWARE:
Nov 14 02:30:40 user nova-compute[75257]: No targets found.
Nov 14 02:30:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:30:40 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:30:40 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6883af36-b79f-4db1-b160-f06b8dd75366]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb65b76-ed6f-4546-a6d8-f924b2ff64ea]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:40 user nova-compute[75257]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 (non-flash)
Nov 14 02:30:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:30:40 user nova-compute[75257]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 (non-flash)
Nov 14 02:30:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a414e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713'): ({'sdc'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Removing single pathed devices sdc {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c9cd1-15e7-4a39-94c6-1f468ebea215]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[22600ca0-b639-4f0f-8beb-9e663b3c6426]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Flushing IO for device /dev/sdc {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3910d3ea-a7ea-44dd-bf83-c7c519214ff4]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[754edb6e-4c0b-4d57-90f5-86263fb271ab]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] SCSI volumes sdc have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2236295a-2d3f-44c0-9c53-47958587546c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8839d5be-e87f-4c91-8f5c-9cc8520c4512]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713, portal: 172.16.0.220,3260]
Nov 14 02:30:40 user nova-compute[75257]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713, portal: 172.16.0.220,3260] successful.
Nov 14 02:30:40 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98f3b222-e2d4-4f42-a1f1-e450ac6d8713 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2805b3e9-6a16-4175-a890-ee2c9091b4ca]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] <== disconnect_volume: return (299ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:30:40 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:30:41 user nova-compute[75257]: DEBUG nova.objects.instance [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'flavor' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:30:41 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-4cefa310-e7cc-4769-b33c-71aad1c601a1 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.715s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:30:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:51 user nova-compute[75257]: INFO nova.compute.manager [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Terminating instance
Nov 14 02:30:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:30:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received event network-vif-unplugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] Acquiring lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] No waiting events found dispatching network-vif-unplugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-0ad8b3ea-3d79-4a15-a93e-2fe0ed87454f req-7bec96c6-d722-492b-98b4-4fe37a3a3003 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received event network-vif-unplugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:30:52 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Instance destroyed successfully.
Nov 14 02:30:52 user nova-compute[75257]: DEBUG nova.objects.instance [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lazy-loading 'resources' on Instance uuid 42cdcf9f-848c-4960-87ca-3a8afa145b6a {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1676388090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1676388090',id=17,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:11:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac29176de8fc434285721bbb6759966d',ramdisk_id='',reservation_id='r-ry4yecf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:13:13Z,user_data=None,user_id='addcfdac50de4b03bd3ad3142508edea',uuid=42cdcf9f-848c-4960-87ca-3a8afa145b6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converting VIF {"id": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "address": "fa:16:3e:bc:5a:32", "network": {"id": "02278215-38bd-499d-a1ab-1d2bb873b0ee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-815105907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac29176de8fc434285721bbb6759966d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc975f85e-f7", "ovs_interfaceid": "c975f85e-f764-4db8-a9e1-e07ca13ce937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=c975f85e-f764-4db8-a9e1-e07ca13ce937,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc975f85e-f7') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG os_vif [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=c975f85e-f764-4db8-a9e1-e07ca13ce937,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc975f85e-f7') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc975f85e-f7, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8f0bbe0-e0a5-4025-a0ab-edb4d6e9bc34) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:52 user nova-compute[75257]: INFO os_vif [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:5a:32,bridge_name='br-int',has_traffic_filtering=True,id=c975f85e-f764-4db8-a9e1-e07ca13ce937,network=Network(02278215-38bd-499d-a1ab-1d2bb873b0ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc975f85e-f7')
Nov 14 02:30:52 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Deleting instance files /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a_del
Nov 14 02:30:52 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Deletion of /opt/stack/data/nova/instances/42cdcf9f-848c-4960-87ca-3a8afa145b6a_del complete
Nov 14 02:30:52 user nova-compute[75257]: INFO nova.compute.manager [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 02:30:52 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:30:52 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:30:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:53 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:30:53 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Took 0.51 seconds to deallocate network for instance.
Nov 14 02:30:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-b9bbf3cf-5946-4ca8-907f-2db7ebf0a031 req-d0d199bc-18c1-40e6-bd9d-922059562c7b service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received event network-vif-deleted-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:53 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:30:53 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:30:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:53 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Deleted allocations for instance 42cdcf9f-848c-4960-87ca-3a8afa145b6a
Nov 14 02:30:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-fa0f7bc7-2870-4053-bd96-62675848ffd3 tempest-ServerBootFromVolumeStableRescueTest-1355021813 tempest-ServerBootFromVolumeStableRescueTest-1355021813-project-member] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.759s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received event network-vif-plugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:30:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] Acquiring lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] Lock "42cdcf9f-848c-4960-87ca-3a8afa145b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:30:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] No waiting events found dispatching network-vif-plugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:30:54 user nova-compute[75257]: WARNING nova.compute.manager [req-8fa1d590-4a04-4b43-93af-64e44922745d req-5bf79cc6-fe2d-4db2-aa58-61a48a8bedb5 service nova] [instance: 42cdcf9f-848c-4960-87ca-3a8afa145b6a] Received unexpected event network-vif-plugged-c975f85e-f764-4db8-a9e1-e07ca13ce937 for instance with vm_state deleted and task_state None.
Nov 14 02:30:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:30:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:30:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:30:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:31:00 user nova-compute[75257]: INFO nova.compute.claims [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Claim successful on node user
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:31:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.policy [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca8f18684c914e9f93d16df39763743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0268a9065e45f5978c20365956e369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:31:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Creating image(s)
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "/opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "/opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk 1073741824" returned: 0 in 0.049s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Successfully created port: 18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Cannot resize image /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Ensure instance console log exists: /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Successfully updated port: 18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquired lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received event network-changed-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Refreshing instance network info cache due to event network-changed-18760f94-6e18-4d6a-8934-5bb624700993. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] Acquiring lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:31:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.network.neutron [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updating instance_info_cache with network_info: [{"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Releasing lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Instance network_info: |[{"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] Acquired lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Refreshing network info cache for port 18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Start _get_guest_xml network_info=[{"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:31:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:31:02 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-724865243',display_name='tempest-AttachVolumeNegativeTest-server-724865243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-724865243',id=48,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN9PjizNz0gpkXqMDx7Aam/2OHp12RcXO1B+SaHkWDuPSJrV1I64ohotW51JDJtQMCceW+wmax80U/6Ip8wb5G0n7gKn5R0gpXf+R8lN4eQFwUCIImWxRBXr9x/I1/FEw==',key_name='tempest-keypair-1397251301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-47e80ntx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=9fcfd6b0-46e9-4194-b83c-dbd004cb5169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:74:01,bridge_name='br-int',has_traffic_filtering=True,id=18760f94-6e18-4d6a-8934-5bb624700993,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18760f94-6e') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.objects.instance [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:31:02 user nova-compute[75257]:   <uuid>9fcfd6b0-46e9-4194-b83c-dbd004cb5169</uuid>
Nov 14 02:31:02 user nova-compute[75257]:   <name>instance-00000030</name>
Nov 14 02:31:02 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:31:02 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:31:02 user nova-compute[75257]:   <metadata>
Nov 14 02:31:02 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:31:02 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:31:02 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeNegativeTest-server-724865243</nova:name>
Nov 14 02:31:02 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:31:02</nova:creationTime>
Nov 14 02:31:02 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:31:02 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:31:02 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:31:02 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:31:02 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:31:02 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:31:02 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:31:02 user nova-compute[75257]:       <nova:owner>
Nov 14 02:31:02 user nova-compute[75257]:         <nova:user uuid="ca8f18684c914e9f93d16df39763743e">tempest-AttachVolumeNegativeTest-1714659318-project-member</nova:user>
Nov 14 02:31:02 user nova-compute[75257]:         <nova:project uuid="bb0268a9065e45f5978c20365956e369">tempest-AttachVolumeNegativeTest-1714659318</nova:project>
Nov 14 02:31:02 user nova-compute[75257]:       </nova:owner>
Nov 14 02:31:02 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:31:02 user nova-compute[75257]:       <nova:ports>
Nov 14 02:31:02 user nova-compute[75257]:         <nova:port uuid="18760f94-6e18-4d6a-8934-5bb624700993">
Nov 14 02:31:02 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 02:31:02 user nova-compute[75257]:         </nova:port>
Nov 14 02:31:02 user nova-compute[75257]:       </nova:ports>
Nov 14 02:31:02 user nova-compute[75257]:     </nova:instance>
Nov 14 02:31:02 user nova-compute[75257]:   </metadata>
Nov 14 02:31:02 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:31:02 user nova-compute[75257]:     <system>
Nov 14 02:31:02 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:31:02 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:31:02 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:31:02 user nova-compute[75257]:       <entry name="serial">9fcfd6b0-46e9-4194-b83c-dbd004cb5169</entry>
Nov 14 02:31:02 user nova-compute[75257]:       <entry name="uuid">9fcfd6b0-46e9-4194-b83c-dbd004cb5169</entry>
Nov 14 02:31:02 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:31:02 user nova-compute[75257]:     </system>
Nov 14 02:31:02 user nova-compute[75257]:   </sysinfo>
Nov 14 02:31:02 user nova-compute[75257]:   <os>
Nov 14 02:31:02 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:31:02 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:31:02 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:31:02 user nova-compute[75257]:   </os>
Nov 14 02:31:02 user nova-compute[75257]:   <features>
Nov 14 02:31:02 user nova-compute[75257]:     <acpi/>
Nov 14 02:31:02 user nova-compute[75257]:     <apic/>
Nov 14 02:31:02 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:31:02 user nova-compute[75257]:   </features>
Nov 14 02:31:02 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:31:02 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:31:02 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:31:02 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:31:02 user nova-compute[75257]:   </clock>
Nov 14 02:31:02 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:31:02 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:31:02 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:31:02 user nova-compute[75257]:   </cpu>
Nov 14 02:31:02 user nova-compute[75257]:   <devices>
Nov 14 02:31:02 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:31:02 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:31:02 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk"/>
Nov 14 02:31:02 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:31:02 user nova-compute[75257]:     </disk>
Nov 14 02:31:02 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:31:02 user nova-compute[75257]:       <mac address="fa:16:3e:df:74:01"/>
Nov 14 02:31:02 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:31:02 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:31:02 user nova-compute[75257]:       <target dev="tap18760f94-6e"/>
Nov 14 02:31:02 user nova-compute[75257]:     </interface>
Nov 14 02:31:02 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:31:02 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/console.log" append="off"/>
Nov 14 02:31:02 user nova-compute[75257]:     </serial>
Nov 14 02:31:02 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:31:02 user nova-compute[75257]:     <video>
Nov 14 02:31:02 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:31:02 user nova-compute[75257]:     </video>
Nov 14 02:31:02 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:31:02 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:31:02 user nova-compute[75257]:     </rng>
Nov 14 02:31:02 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:31:02 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:31:02 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:31:02 user nova-compute[75257]:     </memballoon>
Nov 14 02:31:02 user nova-compute[75257]:   </devices>
Nov 14 02:31:02 user nova-compute[75257]: </domain>
Nov 14 02:31:02 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-724865243',display_name='tempest-AttachVolumeNegativeTest-server-724865243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-724865243',id=48,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN9PjizNz0gpkXqMDx7Aam/2OHp12RcXO1B+SaHkWDuPSJrV1I64ohotW51JDJtQMCceW+wmax80U/6Ip8wb5G0n7gKn5R0gpXf+R8lN4eQFwUCIImWxRBXr9x/I1/FEw==',key_name='tempest-keypair-1397251301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-47e80ntx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=9fcfd6b0-46e9-4194-b83c-dbd004cb5169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:74:01,bridge_name='br-int',has_traffic_filtering=True,id=18760f94-6e18-4d6a-8934-5bb624700993,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18760f94-6e') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG os_vif [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:74:01,bridge_name='br-int',has_traffic_filtering=True,id=18760f94-6e18-4d6a-8934-5bb624700993,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18760f94-6e') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4148e3bc-e131-5709-b22a-39c12798b2c7', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18760f94-6e, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18760f94-6e, col_values=(('qos', UUID('d502cf94-3df5-4fbe-aac3-e9d0b74d2824')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18760f94-6e, col_values=(('external_ids', {'iface-id': '18760f94-6e18-4d6a-8934-5bb624700993', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:74:01', 'vm-uuid': '9fcfd6b0-46e9-4194-b83c-dbd004cb5169'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:02 user nova-compute[75257]: INFO os_vif [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:74:01,bridge_name='br-int',has_traffic_filtering=True,id=18760f94-6e18-4d6a-8934-5bb624700993,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18760f94-6e')
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No VIF found with MAC fa:16:3e:df:74:01, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updated VIF entry in instance network info cache for port 18760f94-6e18-4d6a-8934-5bb624700993. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updating instance_info_cache with network_info: [{"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-262e00cd-7e17-4f3a-9a4d-181477ac99ff req-ee55524a-771e-49b3-b891-e7ba7f7fd2b1 service nova] Releasing lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received event network-changed-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.compute.manager [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Refreshing instance network info cache due to event network-changed-f2ab062e-af46-4816-8393-d3632a9607bd. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] Acquiring lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] Acquired lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.network.neutron [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Refreshing network info cache for port f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:02 user nova-compute[75257]: INFO nova.compute.manager [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Terminating instance
Nov 14 02:31:02 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received event network-vif-unplugged-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] Acquiring lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] No waiting events found dispatching network-vif-unplugged-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-d47b5690-ce0e-4635-925d-5b62a0bca886 req-fcf323a2-4035-49e6-b9ec-28ea29175988 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received event network-vif-unplugged-f2ab062e-af46-4816-8393-d3632a9607bd for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Updated VIF entry in instance network info cache for port f2ab062e-af46-4816-8393-d3632a9607bd. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG nova.network.neutron [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Updating instance_info_cache with network_info: [{"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d4dd649e-f5fd-4427-ab43-6403696f8f65 req-43fe3441-398f-475f-8c22-a7bb770e0858 service nova] Releasing lock "refresh_cache-a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Instance destroyed successfully.
Nov 14 02:31:04 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lazy-loading 'resources' on Instance uuid a9e501a3-dbf6-494f-8f24-50e2d2afa2fe {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2050395413',display_name='tempest-TestVolumeBootPattern-server-2050395413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2050395413',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXjxlRkdo5oPsO/+Z07bOt8W6Q8JL7cOuJwr8kool0H/NKouFgoCv3BOsLMu4GGrIX+3kLFXgqtPbjt+ghJ0NO7o9bx7xPrU99euHCQ0mvMe1SK3bCdaW75tYX2NmuJA==',key_name='tempest-TestVolumeBootPattern-1177175426',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:26:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e49d1cf0a1c457ab943ffd360f1c3da',ramdisk_id='',reservation_id='r-65325dtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1633655156',owner_user_name='tempest-TestVolumeBootPattern-1633655156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:26:29Z,user_data=None,user_id='61052c8663184644aa445e8b29a9d6ed',uuid=a9e501a3-dbf6-494f-8f24-50e2d2afa2fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converting VIF {"id": "f2ab062e-af46-4816-8393-d3632a9607bd", "address": "fa:16:3e:11:cb:bb", "network": {"id": "82975375-7a5b-4666-9ca1-d92490943dd9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1964307814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e49d1cf0a1c457ab943ffd360f1c3da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ab062e-af", "ovs_interfaceid": "f2ab062e-af46-4816-8393-d3632a9607bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:cb:bb,bridge_name='br-int',has_traffic_filtering=True,id=f2ab062e-af46-4816-8393-d3632a9607bd,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ab062e-af') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_vif [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:cb:bb,bridge_name='br-int',has_traffic_filtering=True,id=f2ab062e-af46-4816-8393-d3632a9607bd,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ab062e-af') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2ab062e-af, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=847b1582-ae23-4354-becc-f2d5fb9e93cd) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:04 user nova-compute[75257]: INFO os_vif [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:cb:bb,bridge_name='br-int',has_traffic_filtering=True,id=f2ab062e-af46-4816-8393-d3632a9607bd,network=Network(82975375-7a5b-4666-9ca1-d92490943dd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ab062e-af')
Nov 14 02:31:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'frXTbdAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:31:04 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a5a735-4c94-45c6-9bb3-fd505d3358cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:31:04 user nova-compute[75257]: No targets found.
Nov 14 02:31:04 user nova-compute[75257]: iSNS:
Nov 14 02:31:04 user nova-compute[75257]: No targets found.
Nov 14 02:31:04 user nova-compute[75257]: STATIC:
Nov 14 02:31:04 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8
Nov 14 02:31:04 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:31:04 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:31:04 user nova-compute[75257]: FIRMWARE:
Nov 14 02:31:04 user nova-compute[75257]: No targets found.
Nov 14 02:31:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:31:04 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:31:04 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c648070-2ccc-4dfa-888a-8c6a07f8a997]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca054204-d678-45b1-a087-81e9d33bba7f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:31:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 (non-flash)
Nov 14 02:31:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c2d8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8145a72-5988-437a-bc45-9c5019b03e3f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[06029380-9f23-4e20-acf2-ec5bc265c1ee]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b3e58-2add-479d-9032-fdfa0e3935b9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca890fe7-0c83-4eee-8478-33713b162a2b]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[037b3b64-ba60-496e-9649-4bbd976ed880]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[966ea92d-c811-4179-80e6-f114051da611]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260]
Nov 14 02:31:04 user nova-compute[75257]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8, portal: 172.16.0.220,3260] successful.
Nov 14 02:31:04 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:655abaca-9817-45dd-9bf8-480d3b8aeba8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[98595328-569a-4842-9d71-8d351a00157c]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] <== disconnect_volume: return (285ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:31:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Deleting instance files /opt/stack/data/nova/instances/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe_del
Nov 14 02:31:04 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Deletion of /opt/stack/data/nova/instances/a9e501a3-dbf6-494f-8f24-50e2d2afa2fe_del complete
Nov 14 02:31:04 user nova-compute[75257]: INFO nova.compute.manager [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Took 1.69 seconds to destroy the instance on the hypervisor.
Nov 14 02:31:04 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:31:04 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:31:05 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Took 0.50 seconds to deallocate network for instance.
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-75816713-8eac-42d5-a45c-f0a485ef576e req-34d02600-0e16-4dfb-ad29-775155faef11 service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received event network-vif-deleted-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received event network-vif-plugged-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Acquiring lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] No waiting events found dispatching network-vif-plugged-f2ab062e-af46-4816-8393-d3632a9607bd {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:31:05 user nova-compute[75257]: WARNING nova.compute.manager [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Received unexpected event network-vif-plugged-f2ab062e-af46-4816-8393-d3632a9607bd for instance with vm_state active and task_state deleting.
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received event network-vif-plugged-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] No waiting events found dispatching network-vif-plugged-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:31:05 user nova-compute[75257]: WARNING nova.compute.manager [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received unexpected event network-vif-plugged-18760f94-6e18-4d6a-8934-5bb624700993 for instance with vm_state building and task_state spawning.
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received event network-vif-plugged-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] No waiting events found dispatching network-vif-plugged-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:31:05 user nova-compute[75257]: WARNING nova.compute.manager [req-33c6bb7f-6652-47c5-83ce-0be4637331c6 req-1455c077-e2f6-419a-978e-5f1189f08a2a service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received unexpected event network-vif-plugged-18760f94-6e18-4d6a-8934-5bb624700993 for instance with vm_state building and task_state spawning.
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:31:05 user nova-compute[75257]: INFO nova.compute.manager [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] [instance: a9e501a3-dbf6-494f-8f24-50e2d2afa2fe] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:31:05 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Instance spawned successfully.
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:31:05 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:31:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:06 user nova-compute[75257]: INFO nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 14 02:31:06 user nova-compute[75257]: DEBUG nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:31:06 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Deleted allocations for instance a9e501a3-dbf6-494f-8f24-50e2d2afa2fe
Nov 14 02:31:06 user nova-compute[75257]: INFO nova.compute.manager [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Took 6.05 seconds to build instance.
Nov 14 02:31:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-adca21bb-7615-4d10-8f02-2f7b254e90d0 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.150s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cc5e49c3-3346-4190-b440-11c0c88e5a17 tempest-TestVolumeBootPattern-1633655156 tempest-TestVolumeBootPattern-1633655156-project-member] Lock "a9e501a3-dbf6-494f-8f24-50e2d2afa2fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.311s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:31:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:31:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:31:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:31:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:31:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:31:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:31:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:31:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:31:11 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:31:12 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating instance_info_cache with network_info: [{"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:31:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-053d9dbc-02cd-49b3-9476-02b32b4cb4a1" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:31:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:31:13 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:31:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:13 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:31:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:13 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:14 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:15 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:31:15 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:31:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8558MB free_disk=25.154197692871094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:31:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:31:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:31:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:31:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:31:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:31:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:20 user nova-compute[75257]: INFO nova.compute.manager [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Terminating instance
Nov 14 02:31:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:31:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received event network-vif-unplugged-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] No waiting events found dispatching network-vif-unplugged-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-d46640a0-eabf-4388-a158-718e4ec00031 req-b31507cf-ecc9-4b0b-b8e8-1247cb02183f service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received event network-vif-unplugged-a2de0a50-a398-4b3b-86a8-86137531ca29 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:31:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Instance destroyed successfully.
Nov 14 02:31:21 user nova-compute[75257]: DEBUG nova.objects.instance [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lazy-loading 'resources' on Instance uuid 053d9dbc-02cd-49b3-9476-02b32b4cb4a1 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-851489065',display_name='tempest-SnapshotDataIntegrityTests-server-851489065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-851489065',id=43,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbyFDCLZjgfq+BHFlU+u5qU3pNwn+VrEWZP3k7XoYudOojzEOn6QNKy+4ixzPXb9ct7wd5zaqdaBlNS3NNvOQH5wRd4E8zalWV8GSDwmgErF1VE1iB8oUkqj4G9wkK7Dw==',key_name='tempest-keypair-1055575446',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:25:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d02ec183414b420e8758ffea80902171',ramdisk_id='',reservation_id='r-86u85zjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-169282836',owner_user_name='tempest-SnapshotDataIntegrityTests-169282836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a805502f5d4186a0ade4f44bd0d161',uuid=053d9dbc-02cd-49b3-9476-02b32b4cb4a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Converting VIF {"id": "a2de0a50-a398-4b3b-86a8-86137531ca29", "address": "fa:16:3e:57:42:39", "network": {"id": "3a6db057-93ae-4771-b205-bcf29044c756", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-684969900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02ec183414b420e8758ffea80902171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2de0a50-a3", "ovs_interfaceid": "a2de0a50-a398-4b3b-86a8-86137531ca29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:42:39,bridge_name='br-int',has_traffic_filtering=True,id=a2de0a50-a398-4b3b-86a8-86137531ca29,network=Network(3a6db057-93ae-4771-b205-bcf29044c756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2de0a50-a3') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG os_vif [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:42:39,bridge_name='br-int',has_traffic_filtering=True,id=a2de0a50-a398-4b3b-86a8-86137531ca29,network=Network(3a6db057-93ae-4771-b205-bcf29044c756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2de0a50-a3') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2de0a50-a3, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3113a28a-e159-4123-9dee-52a8ecdf22c5) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:31:21 user nova-compute[75257]: INFO os_vif [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:42:39,bridge_name='br-int',has_traffic_filtering=True,id=a2de0a50-a398-4b3b-86a8-86137531ca29,network=Network(3a6db057-93ae-4771-b205-bcf29044c756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2de0a50-a3')
Nov 14 02:31:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Deleting instance files /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1_del
Nov 14 02:31:21 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Deletion of /opt/stack/data/nova/instances/053d9dbc-02cd-49b3-9476-02b32b4cb4a1_del complete
Nov 14 02:31:21 user nova-compute[75257]: INFO nova.compute.manager [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 02:31:21 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:31:21 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:31:22 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:31:22 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Took 0.68 seconds to deallocate network for instance.
Nov 14 02:31:22 user nova-compute[75257]: DEBUG nova.compute.manager [req-121e045b-d023-4df8-b47e-16fae64d8462 req-36d5dd1b-6968-42b6-9731-8ecd19084d62 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received event network-vif-deleted-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:22 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:31:22 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:31:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:22 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Deleted allocations for instance 053d9dbc-02cd-49b3-9476-02b32b4cb4a1
Nov 14 02:31:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c2a7846c-bdc9-4ceb-aa3d-5a1d05f13c96 tempest-SnapshotDataIntegrityTests-169282836 tempest-SnapshotDataIntegrityTests-169282836-project-member] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.972s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received event network-vif-plugged-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] Acquiring lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] Lock "053d9dbc-02cd-49b3-9476-02b32b4cb4a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:23 user nova-compute[75257]: DEBUG nova.compute.manager [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] No waiting events found dispatching network-vif-plugged-a2de0a50-a398-4b3b-86a8-86137531ca29 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:31:23 user nova-compute[75257]: WARNING nova.compute.manager [req-79f763a7-77cc-4d7b-89b3-fe3c441958b1 req-6ca1f69f-1305-4232-afe3-15872c7f61c2 service nova] [instance: 053d9dbc-02cd-49b3-9476-02b32b4cb4a1] Received unexpected event network-vif-plugged-a2de0a50-a398-4b3b-86a8-86137531ca29 for instance with vm_state deleted and task_state None.
Nov 14 02:31:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-changed-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Refreshing instance network info cache due to event network-changed-b59d72e7-1b00-4b19-a592-0b96e73ce3e3. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:31:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] Acquiring lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:31:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] Acquired lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:31:52 user nova-compute[75257]: DEBUG nova.network.neutron [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Refreshing network info cache for port b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:31:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:52 user nova-compute[75257]: DEBUG nova.network.neutron [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updated VIF entry in instance network info cache for port b59d72e7-1b00-4b19-a592-0b96e73ce3e3. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:31:52 user nova-compute[75257]: DEBUG nova.network.neutron [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:31:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2de81079-13f6-439f-8637-de0000d66b86 req-4d7cdd21-659c-4c13-b9df-4fbea13d8e79 service nova] Releasing lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:31:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:54 user nova-compute[75257]: INFO nova.compute.manager [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Shelving
Nov 14 02:31:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-unplugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] No waiting events found dispatching network-vif-unplugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:31:55 user nova-compute[75257]: WARNING nova.compute.manager [req-0286169b-ae8c-4159-a9b4-7a9a7ec5bc3b req-9b6b5ade-7e39-4ed1-b0ad-3583d4ba49ac service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received unexpected event network-vif-unplugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance with vm_state active and task_state shelving.
Nov 14 02:31:55 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance destroyed successfully.
Nov 14 02:31:55 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Beginning cold snapshot process
Nov 14 02:31:55 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:31:55 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk /opt/stack/data/nova/instances/snapshots/tmpu0_i8_5v/22d0ef9415304d82890ef11580841b4b {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:31:56 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk /opt/stack/data/nova/instances/snapshots/tmpu0_i8_5v/22d0ef9415304d82890ef11580841b4b" returned: 0 in 0.667s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:31:56 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Snapshot extracted, beginning image upload
Nov 14 02:31:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:31:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:31:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:31:57 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:31:57 user nova-compute[75257]: DEBUG nova.compute.manager [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] No waiting events found dispatching network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:31:57 user nova-compute[75257]: WARNING nova.compute.manager [req-1d207004-6f49-4831-b104-44c9cb4b283b req-25b84d89-cba6-424c-8f5a-c9e2817245ac service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received unexpected event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 02:31:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Snapshot image upload complete
Nov 14 02:31:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:31:58 user nova-compute[75257]: INFO nova.compute.manager [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Shelve offloading
Nov 14 02:31:58 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance destroyed successfully.
Nov 14 02:31:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:31:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:31:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquired lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:31:58 user nova-compute[75257]: DEBUG nova.network.neutron [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:31:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:31:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:31:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Releasing lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:32:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance destroyed successfully.
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'resources' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1660326635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1660326635',id=47,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE91lh5tHRqpYXNObplNRCy+a795EP7uZgnVuDAfVsDnERaiLFlI1bE+Gi73FXjtQk5G/hWsJT6013+Zi2k8RWa470GvxW1pXuyWjGkKEApcXI2Ty4VUOS+0NMGPshoXyg==',key_name='tempest-keypair-1707904333',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-imf2fync',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member',shelved_at='2023-11-14T02:31:58.893511',shelved_host='user',shelved_image_id='6517b16f-6f0a-4671-89b6-6d17caae02da'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:31:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=d4b4d4a3-50f6-4381-92ab-01ce730ecb54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG os_vif [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb59d72e7-1b, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=454a0886-5145-4ee6-bcad-e3882ea7f17a) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-changed-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.compute.manager [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Refreshing instance network info cache due to event network-changed-b59d72e7-1b00-4b19-a592-0b96e73ce3e3. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] Acquiring lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] Acquired lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Refreshing network info cache for port b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:32:00 user nova-compute[75257]: INFO os_vif [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b')
Nov 14 02:32:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Deleting instance files /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54_del
Nov 14 02:32:00 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Deletion of /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54_del complete
Nov 14 02:32:00 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Deleted allocations for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54
Nov 14 02:32:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'numa_topology' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.objects.base [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<d4b4d4a3-50f6-4381-92ab-01ce730ecb54> lazy-loaded attributes: resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f896e152-1e8d-472c-8af6-ec0ccae44531 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.835s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updated VIF entry in instance network info cache for port b59d72e7-1b00-4b19-a592-0b96e73ce3e3. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG nova.network.neutron [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:32:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ea363de9-50b9-4a56-b6b4-f9389aa00fdb req-a8bb784f-1d4c-41c7-8a8e-76ebf8da7972 service nova] Releasing lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:32:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:05 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:32:11 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 14 02:32:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:32:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:32:11 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:32:12 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updating instance_info_cache with network_info: [{"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:32:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:32:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:32:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:32:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:15 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:32:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:32:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:32:15 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:32:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:15 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:16 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:32:16 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.12975311279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:32:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:32:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:32:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:32:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:32:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:32:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:23 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:32:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:26 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:31 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:32:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:32:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:32:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:32:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:32:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:32:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:32:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:32:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received event network-changed-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:32:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Refreshing instance network info cache due to event network-changed-18760f94-6e18-4d6a-8934-5bb624700993. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:32:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] Acquiring lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:32:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] Acquired lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:32:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Refreshing network info cache for port 18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:32:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updated VIF entry in instance network info cache for port 18760f94-6e18-4d6a-8934-5bb624700993. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:32:51 user nova-compute[75257]: DEBUG nova.network.neutron [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updating instance_info_cache with network_info: [{"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:32:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f527dcda-3cff-40bd-be3d-071e42b325a7 req-5db996ea-c898-4b45-8f88-db2214db4435 service nova] Releasing lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG nova.objects.instance [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'flavor' on Instance uuid 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:32:52 user nova-compute[75257]: INFO nova.compute.manager [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Attaching volume 5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 to /dev/vdb
Nov 14 02:32:52 user nova-compute[75257]: DEBUG os_brick.utils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f8260e-ec52-4fcb-a901-06a237880087]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dac1c6c-8155-427c-877c-0465337de39c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:52 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f69444-98e4-44fb-ae26-d25a17b8162b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd9ddfd-5457-4a97-9693-27ac054a29fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:32:53 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:32:53 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a88dcca-caff-42c0-85d0-d2ee550b525b]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG os_brick.utils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:32:53 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updating existing volume attachment record: 9b897d92-6d34-41d3-ab68-34987bb4fb9b {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:32:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFyPutCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:32:57 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:32:57 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:32:57 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c8a71-905a-4f33-9c02-16e90a7ec326]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:32:57 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc92dcb-ab12-4809-a1b0-1c5083bd61ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356] added
Nov 14 02:32:57 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed339eda-0e22-4722-90c7-e52d7b7fda3f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4501697a-71dc-43ba-a97f-0f504ef1f119]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFyPutCc {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFyPutCc" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbedfe5f-d426-4c36-bcb6-e4ace6d8f4a4]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFyPutCc'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7c8ff7-fb90-4b1a-b0e8-e4223fb4a43a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03f1368-aadf-4eb4-987a-36530c19bbd7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:32:57 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:32:57 user nova-compute[75257]:  {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:32:57 user nova-compute[75257]: WARNING os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 02:32:57 user nova-compute[75257]: 
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb12c6e-222e-4f67-b2d8-042f9cb4502a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356, portal: 172.16.0.220,3260]
Nov 14 02:32:57 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356, portal: 172.16.0.220,3260] successful.
Nov 14 02:32:57 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d08d91-ef3a-41cb-b59b-b2de3cc199a9]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fb0d63-aa68-48d7-8ac6-e37047261fde]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 (non-flash)
Nov 14 02:32:57 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 (non-flash)
Nov 14 02:32:57 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[30067cfd-8e8b-4639-b437-2d461243ce03]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFyPutCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:32:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:32:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:32:58 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23034343362663966', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:32:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034343362663966', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:32:58 user nova-compute[75257]: DEBUG nova.objects.instance [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'flavor' on Instance uuid 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:32:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:32:58 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:32:58 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:32:58 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:32:58 user nova-compute[75257]:   <serial>5ac8bc2c-8c58-4af5-a105-58f0fd6f6356</serial>
Nov 14 02:32:58 user nova-compute[75257]: </disk>
Nov 14 02:32:58 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:32:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:32:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:32:58 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] No VIF found with MAC fa:16:3e:df:74:01, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:32:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-28077737-4f89-47d7-89f5-faa3c9b9ba83 tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.030s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:32:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:32:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:32:59 user nova-compute[75257]: INFO nova.compute.manager [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Detaching volume 5ac8bc2c-8c58-4af5-a105-58f0fd6f6356
Nov 14 02:32:59 user nova-compute[75257]: INFO nova.virt.block_device [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Attempting to driver detach volume 5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 from mountpoint /dev/vdb
Nov 14 02:32:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Attempting to detach device vdb from instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:32:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:32:59 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:32:59 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:32:59 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:32:59 user nova-compute[75257]:   <serial>5ac8bc2c-8c58-4af5-a105-58f0fd6f6356</serial>
Nov 14 02:32:59 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:32:59 user nova-compute[75257]: </disk>
Nov 14 02:32:59 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:32:59 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully detached device vdb from instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 from the persistent domain config.
Nov 14 02:32:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:32:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:32:59 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:32:59 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:32:59 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:32:59 user nova-compute[75257]:   <serial>5ac8bc2c-8c58-4af5-a105-58f0fd6f6356</serial>
Nov 14 02:32:59 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:32:59 user nova-compute[75257]: </disk>
Nov 14 02:32:59 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:33:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:33:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:06 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:33:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:09 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:33:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:33:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:33:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:33:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:33:12 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:33:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:33:12 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:33:12 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:33:12 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:33:13 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updating instance_info_cache with network_info: [{"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:33:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-9fcfd6b0-46e9-4194-b83c-dbd004cb5169" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:33:13 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:33:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:33:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:33:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:33:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:33:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:33:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:17 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:33:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:17 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:18 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:33:18 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:33:18 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.12033462524414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:33:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:33:20 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 is timed out.
Nov 14 02:33:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully detached device vdb from instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 from the live domain config.
Nov 14 02:33:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFyPutCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:33:20 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ab4ed0-952f-40d0-85a4-3ac6b5209401]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:33:20 user nova-compute[75257]: No targets found.
Nov 14 02:33:20 user nova-compute[75257]: iSNS:
Nov 14 02:33:20 user nova-compute[75257]: No targets found.
Nov 14 02:33:20 user nova-compute[75257]: STATIC:
Nov 14 02:33:20 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356
Nov 14 02:33:20 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:33:20 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:33:20 user nova-compute[75257]: FIRMWARE:
Nov 14 02:33:20 user nova-compute[75257]: No targets found.
Nov 14 02:33:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:33:20 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:33:20 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c0317f-9350-4fa6-aa33-96204ed4fa3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c72f34-d810-41d6-b968-1d2b12bf2c10]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 (non-flash)
Nov 14 02:33:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 (non-flash)
Nov 14 02:33:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c208c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dee7d7-0d32-4203-9576-417c725e7db8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[95230660-17f2-4c1e-8cb4-72cfb6abc4c8]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92e4531-8e38-4bd9-9f5a-7f8fe3383fe0]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[906b24cf-deed-4fe2-a344-9a4fef68e3f5]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[815cb1a1-9606-4183-a891-ae2d23d92d05]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf60219-95ab-4670-a12b-c1f3860c88d6]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356, portal: 172.16.0.220,3260]
Nov 14 02:33:20 user nova-compute[75257]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356, portal: 172.16.0.220,3260] successful.
Nov 14 02:33:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac8bc2c-8c58-4af5-a105-58f0fd6f6356 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b282274a-8685-4c28-8878-98d093c6a634]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] <== disconnect_volume: return (302ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:33:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:33:21 user nova-compute[75257]: DEBUG nova.objects.instance [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'flavor' on Instance uuid 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:33:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-d6daa443-695f-4bd6-8d70-9ae9badcfe7d tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:33:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:47 user nova-compute[75257]: INFO nova.compute.manager [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Unshelving
Nov 14 02:33:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:47 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'pci_requests' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:33:47 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'numa_topology' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:33:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:33:47 user nova-compute[75257]: INFO nova.compute.claims [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Claim successful on node user
Nov 14 02:33:47 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:33:47 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:33:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:47 user nova-compute[75257]: INFO nova.network.neutron [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating port b59d72e7-1b00-4b19-a592-0b96e73ce3e3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 02:33:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:33:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquired lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:33:48 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:33:48 user nova-compute[75257]: DEBUG nova.compute.manager [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-changed-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:33:48 user nova-compute[75257]: DEBUG nova.compute.manager [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Refreshing instance network info cache due to event network-changed-b59d72e7-1b00-4b19-a592-0b96e73ce3e3. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:33:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] Acquiring lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:33:48 user nova-compute[75257]: DEBUG nova.network.neutron [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Releasing lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:33:49 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Creating image(s)
Nov 14 02:33:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] Acquired lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG nova.network.neutron [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Refreshing network info cache for port b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG nova.objects.base [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<d4b4d4a3-50f6-4381-92ab-01ce730ecb54> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "bf8abcabff02423123d9fd8d2c3744cd075a3371" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "bf8abcabff02423123d9fd8d2c3744cd075a3371" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371.part --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:50 user nova-compute[75257]: INFO nova.compute.manager [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Terminating instance
Nov 14 02:33:50 user nova-compute[75257]: DEBUG nova.compute.manager [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371.part --force-share --output=json" returned: 0 in 0.193s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG nova.virt.images [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] 6517b16f-6f0a-4671-89b6-6d17caae02da was qcow2, converting to raw {{(pid=75257) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG nova.privsep.utils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75257) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371.part /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371.converted {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received event network-vif-unplugged-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] No waiting events found dispatching network-vif-unplugged-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG nova.compute.manager [req-6cb5900c-e8ec-4bba-90dc-0931d2aa5dfb req-8febcffd-1ef4-4588-ba8e-0880b250e044 service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received event network-vif-unplugged-18760f94-6e18-4d6a-8934-5bb624700993 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updated VIF entry in instance network info cache for port b59d72e7-1b00-4b19-a592-0b96e73ce3e3. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG nova.network.neutron [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f7d88b37-8ed0-44c4-a0ea-301a1f07c997 req-e42f7417-4ecc-4caf-affa-c7ec5926cd29 service nova] Releasing lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371.part /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371.converted" returned: 0 in 0.869s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:50 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371.converted --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Instance destroyed successfully.
Nov 14 02:33:51 user nova-compute[75257]: DEBUG nova.objects.instance [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lazy-loading 'resources' on Instance uuid 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-724865243',display_name='tempest-AttachVolumeNegativeTest-server-724865243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-724865243',id=48,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN9PjizNz0gpkXqMDx7Aam/2OHp12RcXO1B+SaHkWDuPSJrV1I64ohotW51JDJtQMCceW+wmax80U/6Ip8wb5G0n7gKn5R0gpXf+R8lN4eQFwUCIImWxRBXr9x/I1/FEw==',key_name='tempest-keypair-1397251301',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb0268a9065e45f5978c20365956e369',ramdisk_id='',reservation_id='r-47e80ntx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1714659318',owner_user_name='tempest-AttachVolumeNegativeTest-1714659318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:31:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca8f18684c914e9f93d16df39763743e',uuid=9fcfd6b0-46e9-4194-b83c-dbd004cb5169,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converting VIF {"id": "18760f94-6e18-4d6a-8934-5bb624700993", "address": "fa:16:3e:df:74:01", "network": {"id": "9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-778233061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb0268a9065e45f5978c20365956e369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18760f94-6e", "ovs_interfaceid": "18760f94-6e18-4d6a-8934-5bb624700993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:74:01,bridge_name='br-int',has_traffic_filtering=True,id=18760f94-6e18-4d6a-8934-5bb624700993,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18760f94-6e') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG os_vif [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:74:01,bridge_name='br-int',has_traffic_filtering=True,id=18760f94-6e18-4d6a-8934-5bb624700993,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18760f94-6e') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18760f94-6e, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "bf8abcabff02423123d9fd8d2c3744cd075a3371" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.145s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d502cf94-3df5-4fbe-aac3-e9d0b74d2824) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:33:51 user nova-compute[75257]: INFO os_vif [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:74:01,bridge_name='br-int',has_traffic_filtering=True,id=18760f94-6e18-4d6a-8934-5bb624700993,network=Network(9ac5dc3a-dce1-4a69-89b6-b50ddce0caf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18760f94-6e')
Nov 14 02:33:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Deleting instance files /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169_del
Nov 14 02:33:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Deletion of /opt/stack/data/nova/instances/9fcfd6b0-46e9-4194-b83c-dbd004cb5169_del complete
Nov 14 02:33:51 user nova-compute[75257]: INFO nova.compute.manager [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371 --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "bf8abcabff02423123d9fd8d2c3744cd075a3371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "bf8abcabff02423123d9fd8d2c3744cd075a3371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371 --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371,backing_fmt=raw /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371,backing_fmt=raw /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk 1073741824" returned: 0 in 0.047s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "bf8abcabff02423123d9fd8d2c3744cd075a3371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371 --force-share --output=json" returned: 0 in 0.168s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'migration_context' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG nova.objects.base [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<d4b4d4a3-50f6-4381-92ab-01ce730ecb54> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:33:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Rebasing disk image.
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.168s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:51 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 -F raw /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:33:52 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Took 0.78 seconds to deallocate network for instance.
Nov 14 02:33:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received event network-vif-deleted-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:33:52 user nova-compute[75257]: INFO nova.compute.manager [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Neutron deleted interface 18760f94-6e18-4d6a-8934-5bb624700993; detaching it from the instance and deleting it from the info cache
Nov 14 02:33:52 user nova-compute[75257]: DEBUG nova.network.neutron [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-bebd2c1e-1e04-427a-a861-8196dc75d2b0 req-66724cc8-fd63-4d6d-84b7-bdf4ace96f3c service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Detach interface failed, port_id=18760f94-6e18-4d6a-8934-5bb624700993, reason: Instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:52 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Deleted allocations for instance 9fcfd6b0-46e9-4194-b83c-dbd004cb5169
Nov 14 02:33:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-c1878974-911a-4d56-8505-53e81b6aadee tempest-AttachVolumeNegativeTest-1714659318 tempest-AttachVolumeNegativeTest-1714659318-project-member] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.420s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received event network-vif-plugged-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] Acquiring lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] Lock "9fcfd6b0-46e9-4194-b83c-dbd004cb5169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] No waiting events found dispatching network-vif-plugged-18760f94-6e18-4d6a-8934-5bb624700993 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:33:52 user nova-compute[75257]: WARNING nova.compute.manager [req-f6123263-9e81-445f-b47b-4b45bf01e3ea req-cd378646-1b8a-4f2b-b28c-41cc33dedbae service nova] [instance: 9fcfd6b0-46e9-4194-b83c-dbd004cb5169] Received unexpected event network-vif-plugged-18760f94-6e18-4d6a-8934-5bb624700993 for instance with vm_state deleted and task_state None.
Nov 14 02:33:54 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 -F raw /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk" returned: 0 in 2.399s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Ensure instance console log exists: /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Start _get_guest_xml network_info=[{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8156214da4a72159f24311b8a5230aa1',container_format='bare',created_at=2023-11-14T02:31:55Z,direct_url=<?>,disk_format='qcow2',id=6517b16f-6f0a-4671-89b6-6d17caae02da,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1660326635-shelved',owner='4c246fb95dcc49fd910ec526b1977fc8',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T02:31:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:33:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:33:54 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8156214da4a72159f24311b8a5230aa1',container_format='bare',created_at=2023-11-14T02:31:55Z,direct_url=<?>,disk_format='qcow2',id=6517b16f-6f0a-4671-89b6-6d17caae02da,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1660326635-shelved',owner='4c246fb95dcc49fd910ec526b1977fc8',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T02:31:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<d4b4d4a3-50f6-4381-92ab-01ce730ecb54> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1660326635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1660326635',id=47,image_ref='6517b16f-6f0a-4671-89b6-6d17caae02da',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1707904333',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-imf2fync',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member',shelved_at='2023-11-14T02:31:58.893511',shelved_host='user',shelved_image_id='6517b16f-6f0a-4671-89b6-6d17caae02da'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=d4b4d4a3-50f6-4381-92ab-01ce730ecb54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'pci_devices' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.objects.base [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Object Instance<d4b4d4a3-50f6-4381-92ab-01ce730ecb54> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:33:54 user nova-compute[75257]:   <uuid>d4b4d4a3-50f6-4381-92ab-01ce730ecb54</uuid>
Nov 14 02:33:54 user nova-compute[75257]:   <name>instance-0000002f</name>
Nov 14 02:33:54 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:33:54 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:33:54 user nova-compute[75257]:   <metadata>
Nov 14 02:33:54 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:33:54 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:33:54 user nova-compute[75257]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1660326635</nova:name>
Nov 14 02:33:54 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:33:54</nova:creationTime>
Nov 14 02:33:54 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:33:54 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:33:54 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:33:54 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:33:54 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:33:54 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:33:54 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:33:54 user nova-compute[75257]:       <nova:owner>
Nov 14 02:33:54 user nova-compute[75257]:         <nova:user uuid="d50e0e5a436243f2a91c012a4996185c">tempest-AttachVolumeShelveTestJSON-1725343669-project-member</nova:user>
Nov 14 02:33:54 user nova-compute[75257]:         <nova:project uuid="4c246fb95dcc49fd910ec526b1977fc8">tempest-AttachVolumeShelveTestJSON-1725343669</nova:project>
Nov 14 02:33:54 user nova-compute[75257]:       </nova:owner>
Nov 14 02:33:54 user nova-compute[75257]:       <nova:root type="image" uuid="6517b16f-6f0a-4671-89b6-6d17caae02da"/>
Nov 14 02:33:54 user nova-compute[75257]:       <nova:ports>
Nov 14 02:33:54 user nova-compute[75257]:         <nova:port uuid="b59d72e7-1b00-4b19-a592-0b96e73ce3e3">
Nov 14 02:33:54 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 02:33:54 user nova-compute[75257]:         </nova:port>
Nov 14 02:33:54 user nova-compute[75257]:       </nova:ports>
Nov 14 02:33:54 user nova-compute[75257]:     </nova:instance>
Nov 14 02:33:54 user nova-compute[75257]:   </metadata>
Nov 14 02:33:54 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:33:54 user nova-compute[75257]:     <system>
Nov 14 02:33:54 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:33:54 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:33:54 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:33:54 user nova-compute[75257]:       <entry name="serial">d4b4d4a3-50f6-4381-92ab-01ce730ecb54</entry>
Nov 14 02:33:54 user nova-compute[75257]:       <entry name="uuid">d4b4d4a3-50f6-4381-92ab-01ce730ecb54</entry>
Nov 14 02:33:54 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:33:54 user nova-compute[75257]:     </system>
Nov 14 02:33:54 user nova-compute[75257]:   </sysinfo>
Nov 14 02:33:54 user nova-compute[75257]:   <os>
Nov 14 02:33:54 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:33:54 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:33:54 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:33:54 user nova-compute[75257]:   </os>
Nov 14 02:33:54 user nova-compute[75257]:   <features>
Nov 14 02:33:54 user nova-compute[75257]:     <acpi/>
Nov 14 02:33:54 user nova-compute[75257]:     <apic/>
Nov 14 02:33:54 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:33:54 user nova-compute[75257]:   </features>
Nov 14 02:33:54 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:33:54 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:33:54 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:33:54 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:33:54 user nova-compute[75257]:   </clock>
Nov 14 02:33:54 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:33:54 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:33:54 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:33:54 user nova-compute[75257]:   </cpu>
Nov 14 02:33:54 user nova-compute[75257]:   <devices>
Nov 14 02:33:54 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:33:54 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:33:54 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk"/>
Nov 14 02:33:54 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:33:54 user nova-compute[75257]:     </disk>
Nov 14 02:33:54 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:33:54 user nova-compute[75257]:       <mac address="fa:16:3e:bc:61:11"/>
Nov 14 02:33:54 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:33:54 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:33:54 user nova-compute[75257]:       <target dev="tapb59d72e7-1b"/>
Nov 14 02:33:54 user nova-compute[75257]:     </interface>
Nov 14 02:33:54 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:33:54 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/console.log" append="off"/>
Nov 14 02:33:54 user nova-compute[75257]:     </serial>
Nov 14 02:33:54 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:33:54 user nova-compute[75257]:     <video>
Nov 14 02:33:54 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:33:54 user nova-compute[75257]:     </video>
Nov 14 02:33:54 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:33:54 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:33:54 user nova-compute[75257]:     </rng>
Nov 14 02:33:54 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:33:54 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:33:54 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:33:54 user nova-compute[75257]:     </memballoon>
Nov 14 02:33:54 user nova-compute[75257]:   </devices>
Nov 14 02:33:54 user nova-compute[75257]: </domain>
Nov 14 02:33:54 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1660326635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1660326635',id=47,image_ref='6517b16f-6f0a-4671-89b6-6d17caae02da',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1707904333',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-imf2fync',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member',shelved_at='2023-11-14T02:31:58.893511',shelved_host='user',shelved_image_id='6517b16f-6f0a-4671-89b6-6d17caae02da'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=d4b4d4a3-50f6-4381-92ab-01ce730ecb54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG os_vif [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfe13714-bf4c-5593-879a-072ea3386e36', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb59d72e7-1b, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb59d72e7-1b, col_values=(('qos', UUID('68124bea-25e1-4edc-b925-fa8737f741fd')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb59d72e7-1b, col_values=(('external_ids', {'iface-id': 'b59d72e7-1b00-4b19-a592-0b96e73ce3e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:61:11', 'vm-uuid': 'd4b4d4a3-50f6-4381-92ab-01ce730ecb54'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:54 user nova-compute[75257]: INFO os_vif [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b')
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:33:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] No VIF found with MAC fa:16:3e:bc:61:11, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:33:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:33:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] No waiting events found dispatching network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:33:55 user nova-compute[75257]: WARNING nova.compute.manager [req-7647ddc6-db09-49a5-b472-320af8c93bc0 req-6a537ccf-f0b7-4c72-9f52-dd4572229fac service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received unexpected event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 02:33:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:33:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:33:57 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:33:57 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance spawned successfully.
Nov 14 02:33:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:33:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:33:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:33:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:58 user nova-compute[75257]: DEBUG nova.compute.manager [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] No waiting events found dispatching network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:33:58 user nova-compute[75257]: WARNING nova.compute.manager [req-bed56af4-89f4-4158-8ab5-2bafb6982f24 req-a013fda6-33c5-423c-8030-ed45f06d6681 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received unexpected event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 02:33:58 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:33:58 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7425cccb-65b4-4945-b625-ae5d0329100a tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.716s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:33:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:09 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:13 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:13 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:34:13 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:34:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:34:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:34:13 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:34:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:34:14 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [{"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:34:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-d4b4d4a3-50f6-4381-92ab-01ce730ecb54" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:34:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:34:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:34:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:34:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:34:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:34:18 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:34:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:34:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:34:18 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:34:19 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:34:19 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:34:19 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=25.12188720703125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:34:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:34:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:28 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:34:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:34:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "15e8b92d-057a-4979-a993-d70a64d45fea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "15e8b92d-057a-4979-a993-d70a64d45fea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:35:03 user nova-compute[75257]: INFO nova.compute.claims [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Claim successful on node user
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.network.neutron [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:35:03 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.policy [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9320e58d50b14b298b8aafc11b3afe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f466148e94fc6b7ed0ae1722e5960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:35:03 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Creating image(s)
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "/opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "/opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "/opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.177s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk 1073741824" returned: 0 in 0.068s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:35:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Successfully created port: c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Cannot resize image /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Ensure instance console log exists: /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Successfully updated port: c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "refresh_cache-15e8b92d-057a-4979-a993-d70a64d45fea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquired lock "refresh_cache-15e8b92d-057a-4979-a993-d70a64d45fea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received event network-changed-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.compute.manager [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Refreshing instance network info cache due to event network-changed-c2c3ba47-42d0-42f9-a452-f3a60ba081b3. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] Acquiring lock "refresh_cache-15e8b92d-057a-4979-a993-d70a64d45fea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:35:04 user nova-compute[75257]: DEBUG nova.network.neutron [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Updating instance_info_cache with network_info: [{"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Releasing lock "refresh_cache-15e8b92d-057a-4979-a993-d70a64d45fea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Instance network_info: |[{"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] Acquired lock "refresh_cache-15e8b92d-057a-4979-a993-d70a64d45fea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.network.neutron [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Refreshing network info cache for port c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Start _get_guest_xml network_info=[{"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:35:05 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:35:05 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1570952757',display_name='tempest-VolumesActionsTest-instance-1570952757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1570952757',id=49,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff8f466148e94fc6b7ed0ae1722e5960',ramdisk_id='',reservation_id='r-cmip5aod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1176915290',owner_user_name='tempest-VolumesActionsTest-1176915290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:35:03Z,user_data=None,user_id='9320e58d50b14b298b8aafc11b3afe05',uuid=15e8b92d-057a-4979-a993-d70a64d45fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converting VIF {"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:68:65,bridge_name='br-int',has_traffic_filtering=True,id=c2c3ba47-42d0-42f9-a452-f3a60ba081b3,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c3ba47-42') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.objects.instance [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lazy-loading 'pci_devices' on Instance uuid 15e8b92d-057a-4979-a993-d70a64d45fea {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:35:05 user nova-compute[75257]:   <uuid>15e8b92d-057a-4979-a993-d70a64d45fea</uuid>
Nov 14 02:35:05 user nova-compute[75257]:   <name>instance-00000031</name>
Nov 14 02:35:05 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:35:05 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:35:05 user nova-compute[75257]:   <metadata>
Nov 14 02:35:05 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:35:05 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:35:05 user nova-compute[75257]:       <nova:name>tempest-VolumesActionsTest-instance-1570952757</nova:name>
Nov 14 02:35:05 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:35:05</nova:creationTime>
Nov 14 02:35:05 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:35:05 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:35:05 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:35:05 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:35:05 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:35:05 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:35:05 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:35:05 user nova-compute[75257]:       <nova:owner>
Nov 14 02:35:05 user nova-compute[75257]:         <nova:user uuid="9320e58d50b14b298b8aafc11b3afe05">tempest-VolumesActionsTest-1176915290-project-member</nova:user>
Nov 14 02:35:05 user nova-compute[75257]:         <nova:project uuid="ff8f466148e94fc6b7ed0ae1722e5960">tempest-VolumesActionsTest-1176915290</nova:project>
Nov 14 02:35:05 user nova-compute[75257]:       </nova:owner>
Nov 14 02:35:05 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:35:05 user nova-compute[75257]:       <nova:ports>
Nov 14 02:35:05 user nova-compute[75257]:         <nova:port uuid="c2c3ba47-42d0-42f9-a452-f3a60ba081b3">
Nov 14 02:35:05 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 02:35:05 user nova-compute[75257]:         </nova:port>
Nov 14 02:35:05 user nova-compute[75257]:       </nova:ports>
Nov 14 02:35:05 user nova-compute[75257]:     </nova:instance>
Nov 14 02:35:05 user nova-compute[75257]:   </metadata>
Nov 14 02:35:05 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:35:05 user nova-compute[75257]:     <system>
Nov 14 02:35:05 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:35:05 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:35:05 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:35:05 user nova-compute[75257]:       <entry name="serial">15e8b92d-057a-4979-a993-d70a64d45fea</entry>
Nov 14 02:35:05 user nova-compute[75257]:       <entry name="uuid">15e8b92d-057a-4979-a993-d70a64d45fea</entry>
Nov 14 02:35:05 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:35:05 user nova-compute[75257]:     </system>
Nov 14 02:35:05 user nova-compute[75257]:   </sysinfo>
Nov 14 02:35:05 user nova-compute[75257]:   <os>
Nov 14 02:35:05 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:35:05 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:35:05 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:35:05 user nova-compute[75257]:   </os>
Nov 14 02:35:05 user nova-compute[75257]:   <features>
Nov 14 02:35:05 user nova-compute[75257]:     <acpi/>
Nov 14 02:35:05 user nova-compute[75257]:     <apic/>
Nov 14 02:35:05 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:35:05 user nova-compute[75257]:   </features>
Nov 14 02:35:05 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:35:05 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:35:05 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:35:05 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:35:05 user nova-compute[75257]:   </clock>
Nov 14 02:35:05 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:35:05 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:35:05 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:35:05 user nova-compute[75257]:   </cpu>
Nov 14 02:35:05 user nova-compute[75257]:   <devices>
Nov 14 02:35:05 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:35:05 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:35:05 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk"/>
Nov 14 02:35:05 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:35:05 user nova-compute[75257]:     </disk>
Nov 14 02:35:05 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:35:05 user nova-compute[75257]:       <mac address="fa:16:3e:65:68:65"/>
Nov 14 02:35:05 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:35:05 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:35:05 user nova-compute[75257]:       <target dev="tapc2c3ba47-42"/>
Nov 14 02:35:05 user nova-compute[75257]:     </interface>
Nov 14 02:35:05 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:35:05 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/console.log" append="off"/>
Nov 14 02:35:05 user nova-compute[75257]:     </serial>
Nov 14 02:35:05 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:35:05 user nova-compute[75257]:     <video>
Nov 14 02:35:05 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:35:05 user nova-compute[75257]:     </video>
Nov 14 02:35:05 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:35:05 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:35:05 user nova-compute[75257]:     </rng>
Nov 14 02:35:05 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:35:05 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:35:05 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:35:05 user nova-compute[75257]:     </memballoon>
Nov 14 02:35:05 user nova-compute[75257]:   </devices>
Nov 14 02:35:05 user nova-compute[75257]: </domain>
Nov 14 02:35:05 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1570952757',display_name='tempest-VolumesActionsTest-instance-1570952757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1570952757',id=49,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff8f466148e94fc6b7ed0ae1722e5960',ramdisk_id='',reservation_id='r-cmip5aod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1176915290',owner_user_name='tempest-VolumesActionsTest-1176915290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:35:03Z,user_data=None,user_id='9320e58d50b14b298b8aafc11b3afe05',uuid=15e8b92d-057a-4979-a993-d70a64d45fea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converting VIF {"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:68:65,bridge_name='br-int',has_traffic_filtering=True,id=c2c3ba47-42d0-42f9-a452-f3a60ba081b3,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c3ba47-42') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG os_vif [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:68:65,bridge_name='br-int',has_traffic_filtering=True,id=c2c3ba47-42d0-42f9-a452-f3a60ba081b3,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c3ba47-42') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35823000-fb60-5927-b338-4163c0b55622', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2c3ba47-42, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2c3ba47-42, col_values=(('qos', UUID('7b4cd7f3-cc12-47a9-ad2a-484e712083b7')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2c3ba47-42, col_values=(('external_ids', {'iface-id': 'c2c3ba47-42d0-42f9-a452-f3a60ba081b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:68:65', 'vm-uuid': '15e8b92d-057a-4979-a993-d70a64d45fea'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:05 user nova-compute[75257]: INFO os_vif [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:68:65,bridge_name='br-int',has_traffic_filtering=True,id=c2c3ba47-42d0-42f9-a452-f3a60ba081b3,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c3ba47-42')
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] No VIF found with MAC fa:16:3e:65:68:65, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.network.neutron [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Updated VIF entry in instance network info cache for port c2c3ba47-42d0-42f9-a452-f3a60ba081b3. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG nova.network.neutron [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Updating instance_info_cache with network_info: [{"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:35:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-8bc0a755-2b07-4908-8d0b-5c6818d68197 req-b21a2058-ab00-4ba8-91bd-6e59e893ce7a service nova] Releasing lock "refresh_cache-15e8b92d-057a-4979-a993-d70a64d45fea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:35:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received event network-vif-plugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:35:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] Acquiring lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:06 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:06 user nova-compute[75257]: DEBUG nova.compute.manager [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] No waiting events found dispatching network-vif-plugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:35:06 user nova-compute[75257]: WARNING nova.compute.manager [req-b90fca57-d28f-4839-aa82-13310e68d551 req-84d8d69a-75b9-4da4-8916-d83d1c5f6230 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received unexpected event network-vif-plugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance with vm_state building and task_state spawning.
Nov 14 02:35:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:35:08 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Instance spawned successfully.
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:35:08 user nova-compute[75257]: INFO nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:35:08 user nova-compute[75257]: INFO nova.compute.manager [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Took 5.61 seconds to build instance.
Nov 14 02:35:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-aba1e345-4e3d-481e-be49-f03bf7e0f0c1 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "15e8b92d-057a-4979-a993-d70a64d45fea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.705s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received event network-vif-plugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] Acquiring lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:08 user nova-compute[75257]: DEBUG nova.compute.manager [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] No waiting events found dispatching network-vif-plugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:35:08 user nova-compute[75257]: WARNING nova.compute.manager [req-f6a49198-ef94-4163-b78c-3388cc5defde req-2510cfe5-7c29-4b03-811a-7580240b3698 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received unexpected event network-vif-plugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance with vm_state active and task_state None.
Nov 14 02:35:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:35:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:13 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:35:13 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:35:13 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:35:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-15e8b92d-057a-4979-a993-d70a64d45fea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:35:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-15e8b92d-057a-4979-a993-d70a64d45fea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:35:13 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:35:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 15e8b92d-057a-4979-a993-d70a64d45fea {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:35:14 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Updating instance_info_cache with network_info: [{"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:35:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-15e8b92d-057a-4979-a993-d70a64d45fea" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:35:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:35:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:35:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:15 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:35:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:35:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:35:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:35:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:35:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:35:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:20 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:35:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:35:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:35:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:35:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:35:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:35:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:35:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:35:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:35:22 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:35:22 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:35:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=25.118728637695312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 15e8b92d-057a-4979-a993-d70a64d45fea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:37 user nova-compute[75257]: INFO nova.compute.manager [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Terminating instance
Nov 14 02:35:37 user nova-compute[75257]: DEBUG nova.compute.manager [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-unplugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] No waiting events found dispatching network-vif-unplugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-3862cc6d-c894-46b0-beec-679a145d6dbe req-aef46757-4ec7-40f0-9bec-3ab65f48b953 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-unplugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:35:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Instance destroyed successfully.
Nov 14 02:35:38 user nova-compute[75257]: DEBUG nova.objects.instance [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lazy-loading 'resources' on Instance uuid d4b4d4a3-50f6-4381-92ab-01ce730ecb54 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1660326635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1660326635',id=47,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE91lh5tHRqpYXNObplNRCy+a795EP7uZgnVuDAfVsDnERaiLFlI1bE+Gi73FXjtQk5G/hWsJT6013+Zi2k8RWa470GvxW1pXuyWjGkKEApcXI2Ty4VUOS+0NMGPshoXyg==',key_name='tempest-keypair-1707904333',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:33:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c246fb95dcc49fd910ec526b1977fc8',ramdisk_id='',reservation_id='r-imf2fync',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1725343669',owner_user_name='tempest-AttachVolumeShelveTestJSON-1725343669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d50e0e5a436243f2a91c012a4996185c',uuid=d4b4d4a3-50f6-4381-92ab-01ce730ecb54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converting VIF {"id": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "address": "fa:16:3e:bc:61:11", "network": {"id": "e09cacfd-7877-4055-bd31-ae7e6d56d272", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1011953872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c246fb95dcc49fd910ec526b1977fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59d72e7-1b", "ovs_interfaceid": "b59d72e7-1b00-4b19-a592-0b96e73ce3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG os_vif [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb59d72e7-1b, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68124bea-25e1-4edc-b925-fa8737f741fd) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:35:38 user nova-compute[75257]: INFO os_vif [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:61:11,bridge_name='br-int',has_traffic_filtering=True,id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3,network=Network(e09cacfd-7877-4055-bd31-ae7e6d56d272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59d72e7-1b')
Nov 14 02:35:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Deleting instance files /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54_del
Nov 14 02:35:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Deletion of /opt/stack/data/nova/instances/d4b4d4a3-50f6-4381-92ab-01ce730ecb54_del complete
Nov 14 02:35:38 user nova-compute[75257]: INFO nova.compute.manager [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 02:35:38 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:35:38 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:35:39 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:35:39 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Took 0.63 seconds to deallocate network for instance.
Nov 14 02:35:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-deleted-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:35:39 user nova-compute[75257]: INFO nova.compute.manager [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Neutron deleted interface b59d72e7-1b00-4b19-a592-0b96e73ce3e3; detaching it from the instance and deleting it from the info cache
Nov 14 02:35:39 user nova-compute[75257]: DEBUG nova.network.neutron [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:35:39 user nova-compute[75257]: DEBUG nova.compute.manager [req-dedd8b75-c73b-425b-8bdf-086f75452a22 req-41e808f2-1532-4276-a12b-d281d0ac1079 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Detach interface failed, port_id=b59d72e7-1b00-4b19-a592-0b96e73ce3e3, reason: Instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:35:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:39 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:35:39 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:35:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:39 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Deleted allocations for instance d4b4d4a3-50f6-4381-92ab-01ce730ecb54
Nov 14 02:35:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-76219114-e5eb-47d4-9a5c-54aff857f5c6 tempest-AttachVolumeShelveTestJSON-1725343669 tempest-AttachVolumeShelveTestJSON-1725343669-project-member] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.837s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:40 user nova-compute[75257]: DEBUG nova.compute.manager [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:35:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] Acquiring lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:35:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:35:40 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] Lock "d4b4d4a3-50f6-4381-92ab-01ce730ecb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:35:40 user nova-compute[75257]: DEBUG nova.compute.manager [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] No waiting events found dispatching network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:35:40 user nova-compute[75257]: WARNING nova.compute.manager [req-4b834290-f535-49f7-8701-e2f1a1cf3542 req-08ba02a5-f2eb-4052-834d-3d9d279f48a9 service nova] [instance: d4b4d4a3-50f6-4381-92ab-01ce730ecb54] Received unexpected event network-vif-plugged-b59d72e7-1b00-4b19-a592-0b96e73ce3e3 for instance with vm_state deleted and task_state None.
Nov 14 02:35:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:35:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:36:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:36:14 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:36:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:15 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:36:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:36:21 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:36:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:36:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:36:21 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:36:22 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:36:22 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:36:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.11815643310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 15e8b92d-057a-4979-a993-d70a64d45fea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:36:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:36:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:36:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:36:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:33 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:36:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "15e8b92d-057a-4979-a993-d70a64d45fea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "15e8b92d-057a-4979-a993-d70a64d45fea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:36:53 user nova-compute[75257]: INFO nova.compute.manager [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Terminating instance
Nov 14 02:36:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received event network-vif-unplugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] Acquiring lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] No waiting events found dispatching network-vif-unplugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:36:53 user nova-compute[75257]: DEBUG nova.compute.manager [req-918b4252-e69d-4a0d-a4de-6d513cf51ed7 req-ce661575-8c86-487e-a34b-9e44327dbad2 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received event network-vif-unplugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:36:54 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Instance destroyed successfully.
Nov 14 02:36:54 user nova-compute[75257]: DEBUG nova.objects.instance [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lazy-loading 'resources' on Instance uuid 15e8b92d-057a-4979-a993-d70a64d45fea {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:35:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1570952757',display_name='tempest-VolumesActionsTest-instance-1570952757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1570952757',id=49,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff8f466148e94fc6b7ed0ae1722e5960',ramdisk_id='',reservation_id='r-cmip5aod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1176915290',owner_user_name='tempest-VolumesActionsTest-1176915290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:35:09Z,user_data=None,user_id='9320e58d50b14b298b8aafc11b3afe05',uuid=15e8b92d-057a-4979-a993-d70a64d45fea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converting VIF {"id": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "address": "fa:16:3e:65:68:65", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c3ba47-42", "ovs_interfaceid": "c2c3ba47-42d0-42f9-a452-f3a60ba081b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:68:65,bridge_name='br-int',has_traffic_filtering=True,id=c2c3ba47-42d0-42f9-a452-f3a60ba081b3,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c3ba47-42') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG os_vif [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:68:65,bridge_name='br-int',has_traffic_filtering=True,id=c2c3ba47-42d0-42f9-a452-f3a60ba081b3,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c3ba47-42') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2c3ba47-42, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b4cd7f3-cc12-47a9-ad2a-484e712083b7) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:54 user nova-compute[75257]: INFO os_vif [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:68:65,bridge_name='br-int',has_traffic_filtering=True,id=c2c3ba47-42d0-42f9-a452-f3a60ba081b3,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c3ba47-42')
Nov 14 02:36:54 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Deleting instance files /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea_del
Nov 14 02:36:54 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Deletion of /opt/stack/data/nova/instances/15e8b92d-057a-4979-a993-d70a64d45fea_del complete
Nov 14 02:36:54 user nova-compute[75257]: INFO nova.compute.manager [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 02:36:54 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:36:54 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:36:55 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Took 0.73 seconds to deallocate network for instance.
Nov 14 02:36:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:36:55 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Deleted allocations for instance 15e8b92d-057a-4979-a993-d70a64d45fea
Nov 14 02:36:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-75e1466c-fc59-4b3b-aa63-d6bd654f0be8 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "15e8b92d-057a-4979-a993-d70a64d45fea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.983s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received event network-vif-plugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] Acquiring lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] Lock "15e8b92d-057a-4979-a993-d70a64d45fea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:36:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] No waiting events found dispatching network-vif-plugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:36:55 user nova-compute[75257]: WARNING nova.compute.manager [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received unexpected event network-vif-plugged-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 for instance with vm_state deleted and task_state None.
Nov 14 02:36:55 user nova-compute[75257]: DEBUG nova.compute.manager [req-e1898c6c-5ddd-4fb7-80f7-3c0e958bbbe5 req-5c354796-8a10-43ae-991c-a8f8e1a34a63 service nova] [instance: 15e8b92d-057a-4979-a993-d70a64d45fea] Received event network-vif-deleted-c2c3ba47-42d0-42f9-a452-f3a60ba081b3 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "5165f229-85ea-4bba-abe7-d2ea8f777878" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:36:59 user nova-compute[75257]: INFO nova.compute.claims [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Claim successful on node user
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.network.neutron [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:36:59 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:36:59 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Creating image(s)
Nov 14 02:36:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "/opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "/opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "/opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:36:59 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG nova.policy [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '892f482ffc0d40bc9e1309d41a49ff1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15568f7c994d4677a200047d5f9081a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk 1073741824" returned: 0 in 0.048s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG nova.network.neutron [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Successfully created port: a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Cannot resize image /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Ensure instance console log exists: /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Successfully updated port: a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquired lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received event network-changed-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.compute.manager [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Refreshing instance network info cache due to event network-changed-a2234980-33ea-4b64-a2fd-8e09f63cb010. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] Acquiring lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.neutron [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Updating instance_info_cache with network_info: [{"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Releasing lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Instance network_info: |[{"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] Acquired lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.neutron [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Refreshing network info cache for port a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Start _get_guest_xml network_info=[{"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:37:01 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:37:01 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2021763470',display_name='tempest-VolumesNegativeTest-instance-2021763470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2021763470',id=50,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15568f7c994d4677a200047d5f9081a8',ramdisk_id='',reservation_id='r-m5mun7fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1358615352',owner_user_name='tempest-VolumesNegativeTest-1358615352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:37:00Z,user_data=None,user_id='892f482ffc0d40bc9e1309d41a49ff1b',uuid=5165f229-85ea-4bba-abe7-d2ea8f777878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Converting VIF {"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:2f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a2234980-33ea-4b64-a2fd-8e09f63cb010,network=Network(950f3db4-a3b7-451b-9046-81d46dd8d4f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2234980-33') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.objects.instance [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lazy-loading 'pci_devices' on Instance uuid 5165f229-85ea-4bba-abe7-d2ea8f777878 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:37:01 user nova-compute[75257]:   <uuid>5165f229-85ea-4bba-abe7-d2ea8f777878</uuid>
Nov 14 02:37:01 user nova-compute[75257]:   <name>instance-00000032</name>
Nov 14 02:37:01 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:37:01 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:37:01 user nova-compute[75257]:   <metadata>
Nov 14 02:37:01 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:37:01 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:37:01 user nova-compute[75257]:       <nova:name>tempest-VolumesNegativeTest-instance-2021763470</nova:name>
Nov 14 02:37:01 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:37:01</nova:creationTime>
Nov 14 02:37:01 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:37:01 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:37:01 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:37:01 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:37:01 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:37:01 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:37:01 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:37:01 user nova-compute[75257]:       <nova:owner>
Nov 14 02:37:01 user nova-compute[75257]:         <nova:user uuid="892f482ffc0d40bc9e1309d41a49ff1b">tempest-VolumesNegativeTest-1358615352-project-member</nova:user>
Nov 14 02:37:01 user nova-compute[75257]:         <nova:project uuid="15568f7c994d4677a200047d5f9081a8">tempest-VolumesNegativeTest-1358615352</nova:project>
Nov 14 02:37:01 user nova-compute[75257]:       </nova:owner>
Nov 14 02:37:01 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:37:01 user nova-compute[75257]:       <nova:ports>
Nov 14 02:37:01 user nova-compute[75257]:         <nova:port uuid="a2234980-33ea-4b64-a2fd-8e09f63cb010">
Nov 14 02:37:01 user nova-compute[75257]:           <nova:ip type="fixed" address="192.168.233.165" ipVersion="4"/>
Nov 14 02:37:01 user nova-compute[75257]:         </nova:port>
Nov 14 02:37:01 user nova-compute[75257]:       </nova:ports>
Nov 14 02:37:01 user nova-compute[75257]:     </nova:instance>
Nov 14 02:37:01 user nova-compute[75257]:   </metadata>
Nov 14 02:37:01 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:37:01 user nova-compute[75257]:     <system>
Nov 14 02:37:01 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:37:01 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:37:01 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:37:01 user nova-compute[75257]:       <entry name="serial">5165f229-85ea-4bba-abe7-d2ea8f777878</entry>
Nov 14 02:37:01 user nova-compute[75257]:       <entry name="uuid">5165f229-85ea-4bba-abe7-d2ea8f777878</entry>
Nov 14 02:37:01 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:37:01 user nova-compute[75257]:     </system>
Nov 14 02:37:01 user nova-compute[75257]:   </sysinfo>
Nov 14 02:37:01 user nova-compute[75257]:   <os>
Nov 14 02:37:01 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:37:01 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:37:01 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:37:01 user nova-compute[75257]:   </os>
Nov 14 02:37:01 user nova-compute[75257]:   <features>
Nov 14 02:37:01 user nova-compute[75257]:     <acpi/>
Nov 14 02:37:01 user nova-compute[75257]:     <apic/>
Nov 14 02:37:01 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:37:01 user nova-compute[75257]:   </features>
Nov 14 02:37:01 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:37:01 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:37:01 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:37:01 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:37:01 user nova-compute[75257]:   </clock>
Nov 14 02:37:01 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:37:01 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:37:01 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:37:01 user nova-compute[75257]:   </cpu>
Nov 14 02:37:01 user nova-compute[75257]:   <devices>
Nov 14 02:37:01 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:37:01 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:37:01 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk"/>
Nov 14 02:37:01 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:37:01 user nova-compute[75257]:     </disk>
Nov 14 02:37:01 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:37:01 user nova-compute[75257]:       <mac address="fa:16:3e:69:2f:8a"/>
Nov 14 02:37:01 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:37:01 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:37:01 user nova-compute[75257]:       <target dev="tapa2234980-33"/>
Nov 14 02:37:01 user nova-compute[75257]:     </interface>
Nov 14 02:37:01 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:37:01 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/console.log" append="off"/>
Nov 14 02:37:01 user nova-compute[75257]:     </serial>
Nov 14 02:37:01 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:37:01 user nova-compute[75257]:     <video>
Nov 14 02:37:01 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:37:01 user nova-compute[75257]:     </video>
Nov 14 02:37:01 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:37:01 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:37:01 user nova-compute[75257]:     </rng>
Nov 14 02:37:01 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:37:01 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:37:01 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:37:01 user nova-compute[75257]:     </memballoon>
Nov 14 02:37:01 user nova-compute[75257]:   </devices>
Nov 14 02:37:01 user nova-compute[75257]: </domain>
Nov 14 02:37:01 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2021763470',display_name='tempest-VolumesNegativeTest-instance-2021763470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2021763470',id=50,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15568f7c994d4677a200047d5f9081a8',ramdisk_id='',reservation_id='r-m5mun7fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1358615352',owner_user_name='tempest-VolumesNegativeTest-1358615352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:37:00Z,user_data=None,user_id='892f482ffc0d40bc9e1309d41a49ff1b',uuid=5165f229-85ea-4bba-abe7-d2ea8f777878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Converting VIF {"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:2f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a2234980-33ea-4b64-a2fd-8e09f63cb010,network=Network(950f3db4-a3b7-451b-9046-81d46dd8d4f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2234980-33') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG os_vif [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:2f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a2234980-33ea-4b64-a2fd-8e09f63cb010,network=Network(950f3db4-a3b7-451b-9046-81d46dd8d4f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2234980-33') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd87a995c-cc13-58d8-890f-4f39e867fe6d', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2234980-33, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2234980-33, col_values=(('qos', UUID('b6a3ba76-12e6-4ffe-80eb-e87220551022')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2234980-33, col_values=(('external_ids', {'iface-id': 'a2234980-33ea-4b64-a2fd-8e09f63cb010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:2f:8a', 'vm-uuid': '5165f229-85ea-4bba-abe7-d2ea8f777878'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:01 user nova-compute[75257]: INFO os_vif [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:2f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a2234980-33ea-4b64-a2fd-8e09f63cb010,network=Network(950f3db4-a3b7-451b-9046-81d46dd8d4f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2234980-33')
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] No VIF found with MAC fa:16:3e:69:2f:8a, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.neutron [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Updated VIF entry in instance network info cache for port a2234980-33ea-4b64-a2fd-8e09f63cb010. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG nova.network.neutron [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Updating instance_info_cache with network_info: [{"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:37:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-301b0be8-ce49-4df4-9337-150d7a14011b req-f80219c2-1e3e-4e8f-98cf-ffbe5d061a9d service nova] Releasing lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:37:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received event network-vif-plugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:37:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] Acquiring lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:03 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:03 user nova-compute[75257]: DEBUG nova.compute.manager [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] No waiting events found dispatching network-vif-plugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:37:03 user nova-compute[75257]: WARNING nova.compute.manager [req-b9343512-c3b0-4d1f-86b5-ea3850a0e8a3 req-beb65151-99a0-4d5f-8b6f-bb691b05db2c service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received unexpected event network-vif-plugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance with vm_state building and task_state spawning.
Nov 14 02:37:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:37:05 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Instance spawned successfully.
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:05 user nova-compute[75257]: INFO nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:37:05 user nova-compute[75257]: INFO nova.compute.manager [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Took 5.80 seconds to build instance.
Nov 14 02:37:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-22122dd3-fe43-4139-9057-fc6c305a8a21 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.894s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received event network-vif-plugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] Acquiring lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:05 user nova-compute[75257]: DEBUG nova.compute.manager [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] No waiting events found dispatching network-vif-plugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:37:05 user nova-compute[75257]: WARNING nova.compute.manager [req-ab9281e1-c4d7-408c-b1be-9d61577ab54f req-b96af865-5d9a-4fe6-8168-a707c2e80046 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received unexpected event network-vif-plugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance with vm_state active and task_state None.
Nov 14 02:37:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:14 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:15 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:37:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:37:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:37:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:37:15 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:37:15 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 5165f229-85ea-4bba-abe7-d2ea8f777878 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:37:16 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Updating instance_info_cache with network_info: [{"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:37:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:37:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:37:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:37:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:37:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:22 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:23 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:37:23 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.108535766601562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 5165f229-85ea-4bba-abe7-d2ea8f777878 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:37:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:34 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:37:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:37:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:37:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:37:45 user nova-compute[75257]: INFO nova.compute.claims [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Claim successful on node user
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:37:45 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.policy [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9320e58d50b14b298b8aafc11b3afe05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8f466148e94fc6b7ed0ae1722e5960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:37:45 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Creating image(s)
Nov 14 02:37:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "/opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "/opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:45 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.169s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk 1073741824" returned: 0 in 0.059s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Successfully created port: dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.167s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Cannot resize image /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Ensure instance console log exists: /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Successfully updated port: dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "refresh_cache-7a919147-feb1-4f0b-9571-f5b3e8edaa59" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquired lock "refresh_cache-7a919147-feb1-4f0b-9571-f5b3e8edaa59" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received event network-changed-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.compute.manager [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Refreshing instance network info cache due to event network-changed-dd39e651-4371-4f6c-9ddf-1f8aeed0c400. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] Acquiring lock "refresh_cache-7a919147-feb1-4f0b-9571-f5b3e8edaa59" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.network.neutron [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Updating instance_info_cache with network_info: [{"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Releasing lock "refresh_cache-7a919147-feb1-4f0b-9571-f5b3e8edaa59" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Instance network_info: |[{"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] Acquired lock "refresh_cache-7a919147-feb1-4f0b-9571-f5b3e8edaa59" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.network.neutron [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Refreshing network info cache for port dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Start _get_guest_xml network_info=[{"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:37:47 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:37:47 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1179334455',display_name='tempest-VolumesActionsTest-instance-1179334455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1179334455',id=51,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff8f466148e94fc6b7ed0ae1722e5960',ramdisk_id='',reservation_id='r-w6uz0nuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1176915290',owner_user_name='tempest-VolumesActionsTest-1176915290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:37:46Z,user_data=None,user_id='9320e58d50b14b298b8aafc11b3afe05',uuid=7a919147-feb1-4f0b-9571-f5b3e8edaa59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converting VIF {"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=dd39e651-4371-4f6c-9ddf-1f8aeed0c400,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd39e651-43') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a919147-feb1-4f0b-9571-f5b3e8edaa59 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:37:47 user nova-compute[75257]:   <uuid>7a919147-feb1-4f0b-9571-f5b3e8edaa59</uuid>
Nov 14 02:37:47 user nova-compute[75257]:   <name>instance-00000033</name>
Nov 14 02:37:47 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:37:47 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:37:47 user nova-compute[75257]:   <metadata>
Nov 14 02:37:47 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:37:47 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:37:47 user nova-compute[75257]:       <nova:name>tempest-VolumesActionsTest-instance-1179334455</nova:name>
Nov 14 02:37:47 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:37:47</nova:creationTime>
Nov 14 02:37:47 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:37:47 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:37:47 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:37:47 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:37:47 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:37:47 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:37:47 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:37:47 user nova-compute[75257]:       <nova:owner>
Nov 14 02:37:47 user nova-compute[75257]:         <nova:user uuid="9320e58d50b14b298b8aafc11b3afe05">tempest-VolumesActionsTest-1176915290-project-member</nova:user>
Nov 14 02:37:47 user nova-compute[75257]:         <nova:project uuid="ff8f466148e94fc6b7ed0ae1722e5960">tempest-VolumesActionsTest-1176915290</nova:project>
Nov 14 02:37:47 user nova-compute[75257]:       </nova:owner>
Nov 14 02:37:47 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:37:47 user nova-compute[75257]:       <nova:ports>
Nov 14 02:37:47 user nova-compute[75257]:         <nova:port uuid="dd39e651-4371-4f6c-9ddf-1f8aeed0c400">
Nov 14 02:37:47 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 02:37:47 user nova-compute[75257]:         </nova:port>
Nov 14 02:37:47 user nova-compute[75257]:       </nova:ports>
Nov 14 02:37:47 user nova-compute[75257]:     </nova:instance>
Nov 14 02:37:47 user nova-compute[75257]:   </metadata>
Nov 14 02:37:47 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:37:47 user nova-compute[75257]:     <system>
Nov 14 02:37:47 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:37:47 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:37:47 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:37:47 user nova-compute[75257]:       <entry name="serial">7a919147-feb1-4f0b-9571-f5b3e8edaa59</entry>
Nov 14 02:37:47 user nova-compute[75257]:       <entry name="uuid">7a919147-feb1-4f0b-9571-f5b3e8edaa59</entry>
Nov 14 02:37:47 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:37:47 user nova-compute[75257]:     </system>
Nov 14 02:37:47 user nova-compute[75257]:   </sysinfo>
Nov 14 02:37:47 user nova-compute[75257]:   <os>
Nov 14 02:37:47 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:37:47 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:37:47 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:37:47 user nova-compute[75257]:   </os>
Nov 14 02:37:47 user nova-compute[75257]:   <features>
Nov 14 02:37:47 user nova-compute[75257]:     <acpi/>
Nov 14 02:37:47 user nova-compute[75257]:     <apic/>
Nov 14 02:37:47 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:37:47 user nova-compute[75257]:   </features>
Nov 14 02:37:47 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:37:47 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:37:47 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:37:47 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:37:47 user nova-compute[75257]:   </clock>
Nov 14 02:37:47 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:37:47 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:37:47 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:37:47 user nova-compute[75257]:   </cpu>
Nov 14 02:37:47 user nova-compute[75257]:   <devices>
Nov 14 02:37:47 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:37:47 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:37:47 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk"/>
Nov 14 02:37:47 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:37:47 user nova-compute[75257]:     </disk>
Nov 14 02:37:47 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:37:47 user nova-compute[75257]:       <mac address="fa:16:3e:f2:cc:e9"/>
Nov 14 02:37:47 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:37:47 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:37:47 user nova-compute[75257]:       <target dev="tapdd39e651-43"/>
Nov 14 02:37:47 user nova-compute[75257]:     </interface>
Nov 14 02:37:47 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:37:47 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/console.log" append="off"/>
Nov 14 02:37:47 user nova-compute[75257]:     </serial>
Nov 14 02:37:47 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:37:47 user nova-compute[75257]:     <video>
Nov 14 02:37:47 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:37:47 user nova-compute[75257]:     </video>
Nov 14 02:37:47 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:37:47 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:37:47 user nova-compute[75257]:     </rng>
Nov 14 02:37:47 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:37:47 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:37:47 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:37:47 user nova-compute[75257]:     </memballoon>
Nov 14 02:37:47 user nova-compute[75257]:   </devices>
Nov 14 02:37:47 user nova-compute[75257]: </domain>
Nov 14 02:37:47 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1179334455',display_name='tempest-VolumesActionsTest-instance-1179334455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1179334455',id=51,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff8f466148e94fc6b7ed0ae1722e5960',ramdisk_id='',reservation_id='r-w6uz0nuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1176915290',owner_user_name='tempest-VolumesActionsTest-1176915290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:37:46Z,user_data=None,user_id='9320e58d50b14b298b8aafc11b3afe05',uuid=7a919147-feb1-4f0b-9571-f5b3e8edaa59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converting VIF {"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=dd39e651-4371-4f6c-9ddf-1f8aeed0c400,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd39e651-43') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG os_vif [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=dd39e651-4371-4f6c-9ddf-1f8aeed0c400,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd39e651-43') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c113c493-a10f-5ddb-8803-8bf54a1aaf1b', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd39e651-43, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd39e651-43, col_values=(('qos', UUID('0ed372c8-bd69-4c6d-aec9-72854eff11bd')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd39e651-43, col_values=(('external_ids', {'iface-id': 'dd39e651-4371-4f6c-9ddf-1f8aeed0c400', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:cc:e9', 'vm-uuid': '7a919147-feb1-4f0b-9571-f5b3e8edaa59'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:47 user nova-compute[75257]: INFO os_vif [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=dd39e651-4371-4f6c-9ddf-1f8aeed0c400,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd39e651-43')
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:37:47 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] No VIF found with MAC fa:16:3e:f2:cc:e9, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:37:48 user nova-compute[75257]: DEBUG nova.network.neutron [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Updated VIF entry in instance network info cache for port dd39e651-4371-4f6c-9ddf-1f8aeed0c400. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:37:48 user nova-compute[75257]: DEBUG nova.network.neutron [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Updating instance_info_cache with network_info: [{"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:37:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d6906d2f-5310-4b4d-9475-c1de4f89d9b9 req-a1dab313-ab9a-49cc-9063-f793f2784578 service nova] Releasing lock "refresh_cache-7a919147-feb1-4f0b-9571-f5b3e8edaa59" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received event network-vif-plugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] Acquiring lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] No waiting events found dispatching network-vif-plugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:37:49 user nova-compute[75257]: WARNING nova.compute.manager [req-a9da17b4-2383-4b9c-97b9-09c025eedefe req-ca8a976a-c996-4330-82a2-466d17014aba service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received unexpected event network-vif-plugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance with vm_state building and task_state spawning.
Nov 14 02:37:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:37:51 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Instance spawned successfully.
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:37:51 user nova-compute[75257]: INFO nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received event network-vif-plugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] Acquiring lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] No waiting events found dispatching network-vif-plugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:37:51 user nova-compute[75257]: WARNING nova.compute.manager [req-54a625b0-0aae-40ac-8d01-37c5850e6948 req-4d0bcf91-c112-48e3-bc43-08ef55f22efd service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received unexpected event network-vif-plugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance with vm_state building and task_state spawning.
Nov 14 02:37:51 user nova-compute[75257]: INFO nova.compute.manager [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Took 6.04 seconds to build instance.
Nov 14 02:37:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b2a56e34-797e-4022-8b3d-b7972c50b51e tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.158s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:37:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:37:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:37:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:38:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:38:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:38:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:38:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:16 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:38:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:38:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:38:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:38:16 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:38:16 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 5165f229-85ea-4bba-abe7-d2ea8f777878 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:38:17 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Updating instance_info_cache with network_info: [{"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:38:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-5165f229-85ea-4bba-abe7-d2ea8f777878" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:38:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:38:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:38:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:38:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:38:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:38:23 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:38:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:38:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:38:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:38:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:38:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:38:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=25.07735824584961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 5165f229-85ea-4bba-abe7-d2ea8f777878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:38:24 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:38:25 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:38:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:38:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:38:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:38:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:38:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:38:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:37 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:38:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:38:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:38:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:38:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:38:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:38:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:38:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:38:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "5165f229-85ea-4bba-abe7-d2ea8f777878" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:38:49 user nova-compute[75257]: INFO nova.compute.manager [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Terminating instance
Nov 14 02:38:49 user nova-compute[75257]: DEBUG nova.compute.manager [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received event network-vif-unplugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] Acquiring lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] No waiting events found dispatching network-vif-unplugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:38:49 user nova-compute[75257]: DEBUG nova.compute.manager [req-b1a9029d-9cf6-48fa-97f7-e010c213d9f2 req-4c6da5e7-5e5e-43ee-8c9f-47bd91622d75 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received event network-vif-unplugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:50 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Instance destroyed successfully.
Nov 14 02:38:50 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lazy-loading 'resources' on Instance uuid 5165f229-85ea-4bba-abe7-d2ea8f777878 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2021763470',display_name='tempest-VolumesNegativeTest-instance-2021763470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2021763470',id=50,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:37:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15568f7c994d4677a200047d5f9081a8',ramdisk_id='',reservation_id='r-m5mun7fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1358615352',owner_user_name='tempest-VolumesNegativeTest-1358615352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:37:05Z,user_data=None,user_id='892f482ffc0d40bc9e1309d41a49ff1b',uuid=5165f229-85ea-4bba-abe7-d2ea8f777878,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Converting VIF {"id": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "address": "fa:16:3e:69:2f:8a", "network": {"id": "950f3db4-a3b7-451b-9046-81d46dd8d4f5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "287183b1322b4e14bb1529cf4b1622c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2234980-33", "ovs_interfaceid": "a2234980-33ea-4b64-a2fd-8e09f63cb010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:2f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a2234980-33ea-4b64-a2fd-8e09f63cb010,network=Network(950f3db4-a3b7-451b-9046-81d46dd8d4f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2234980-33') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG os_vif [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:2f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a2234980-33ea-4b64-a2fd-8e09f63cb010,network=Network(950f3db4-a3b7-451b-9046-81d46dd8d4f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2234980-33') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2234980-33, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6a3ba76-12e6-4ffe-80eb-e87220551022) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:38:50 user nova-compute[75257]: INFO os_vif [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:2f:8a,bridge_name='br-int',has_traffic_filtering=True,id=a2234980-33ea-4b64-a2fd-8e09f63cb010,network=Network(950f3db4-a3b7-451b-9046-81d46dd8d4f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2234980-33')
Nov 14 02:38:50 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Deleting instance files /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878_del
Nov 14 02:38:50 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Deletion of /opt/stack/data/nova/instances/5165f229-85ea-4bba-abe7-d2ea8f777878_del complete
Nov 14 02:38:50 user nova-compute[75257]: INFO nova.compute.manager [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 14 02:38:50 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:38:50 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Took 0.44 seconds to deallocate network for instance.
Nov 14 02:38:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:38:50 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:38:50 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Deleted allocations for instance 5165f229-85ea-4bba-abe7-d2ea8f777878
Nov 14 02:38:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f97be622-3512-4e7f-a48c-30090370f0a4 tempest-VolumesNegativeTest-1358615352 tempest-VolumesNegativeTest-1358615352-project-member] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.461s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:38:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received event network-vif-plugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:38:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] Acquiring lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:38:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:38:51 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] Lock "5165f229-85ea-4bba-abe7-d2ea8f777878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:38:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] No waiting events found dispatching network-vif-plugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:38:51 user nova-compute[75257]: WARNING nova.compute.manager [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received unexpected event network-vif-plugged-a2234980-33ea-4b64-a2fd-8e09f63cb010 for instance with vm_state deleted and task_state None.
Nov 14 02:38:51 user nova-compute[75257]: DEBUG nova.compute.manager [req-e5b2d69b-a509-4c79-b372-8b19aa72e719 req-ebe759eb-4602-4f10-8285-9bab39a4a024 service nova] [instance: 5165f229-85ea-4bba-abe7-d2ea8f777878] Received event network-vif-deleted-a2234980-33ea-4b64-a2fd-8e09f63cb010 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:38:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:39:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:39:11 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:39:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:39:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:39:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:39:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-7a919147-feb1-4f0b-9571-f5b3e8edaa59" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:39:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-7a919147-feb1-4f0b-9571-f5b3e8edaa59" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:39:18 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:39:19 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Updating instance_info_cache with network_info: [{"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:39:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-7a919147-feb1-4f0b-9571-f5b3e8edaa59" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:39:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:39:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:39:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:39:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:39:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:39:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:39:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:39:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:39:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:39:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:39:22 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:39:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:39:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:39:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:39:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:39:23 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:39:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:39:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:39:23 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:39:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:39:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:39:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.104496002197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:39:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:39:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:39:26 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:39:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:39:36 user nova-compute[75257]: INFO nova.compute.manager [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Terminating instance
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received event network-vif-unplugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] Acquiring lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] No waiting events found dispatching network-vif-unplugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-69b22038-f905-4b5a-8a6a-231f3a1ea0f7 req-ff479961-2081-4919-a7b8-e1a237a97ecc service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received event network-vif-unplugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Instance destroyed successfully.
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.objects.instance [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lazy-loading 'resources' on Instance uuid 7a919147-feb1-4f0b-9571-f5b3e8edaa59 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:37:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1179334455',display_name='tempest-VolumesActionsTest-instance-1179334455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1179334455',id=51,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:37:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff8f466148e94fc6b7ed0ae1722e5960',ramdisk_id='',reservation_id='r-w6uz0nuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1176915290',owner_user_name='tempest-VolumesActionsTest-1176915290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:37:51Z,user_data=None,user_id='9320e58d50b14b298b8aafc11b3afe05',uuid=7a919147-feb1-4f0b-9571-f5b3e8edaa59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converting VIF {"id": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "address": "fa:16:3e:f2:cc:e9", "network": {"id": "609cdccf-0cd2-43bf-a056-920b23dd9b1b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248808882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff8f466148e94fc6b7ed0ae1722e5960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd39e651-43", "ovs_interfaceid": "dd39e651-4371-4f6c-9ddf-1f8aeed0c400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=dd39e651-4371-4f6c-9ddf-1f8aeed0c400,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd39e651-43') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG os_vif [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=dd39e651-4371-4f6c-9ddf-1f8aeed0c400,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd39e651-43') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd39e651-43, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ed372c8-bd69-4c6d-aec9-72854eff11bd) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:39:36 user nova-compute[75257]: INFO os_vif [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:cc:e9,bridge_name='br-int',has_traffic_filtering=True,id=dd39e651-4371-4f6c-9ddf-1f8aeed0c400,network=Network(609cdccf-0cd2-43bf-a056-920b23dd9b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd39e651-43')
Nov 14 02:39:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Deleting instance files /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59_del
Nov 14 02:39:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Deletion of /opt/stack/data/nova/instances/7a919147-feb1-4f0b-9571-f5b3e8edaa59_del complete
Nov 14 02:39:36 user nova-compute[75257]: INFO nova.compute.manager [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 02:39:36 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:39:36 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:39:37 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:39:37 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Took 0.43 seconds to deallocate network for instance.
Nov 14 02:39:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received event network-vif-deleted-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:39:37 user nova-compute[75257]: INFO nova.compute.manager [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Neutron deleted interface dd39e651-4371-4f6c-9ddf-1f8aeed0c400; detaching it from the instance and deleting it from the info cache
Nov 14 02:39:37 user nova-compute[75257]: DEBUG nova.network.neutron [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:39:37 user nova-compute[75257]: DEBUG nova.compute.manager [req-f53dd89a-ee2a-4e7a-bf5e-88e27e300c13 req-c7ce5d82-b258-4cf6-9c42-915d65363b22 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Detach interface failed, port_id=dd39e651-4371-4f6c-9ddf-1f8aeed0c400, reason: Instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59 could not be found. {{(pid=75257) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 02:39:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:39:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:39:37 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:39:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:39:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:39:37 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Deleted allocations for instance 7a919147-feb1-4f0b-9571-f5b3e8edaa59
Nov 14 02:39:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-7e4536d9-bc53-4e14-b017-a76d9ac5e212 tempest-VolumesActionsTest-1176915290 tempest-VolumesActionsTest-1176915290-project-member] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.568s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:39:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received event network-vif-plugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:39:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] Acquiring lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:39:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:39:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] Lock "7a919147-feb1-4f0b-9571-f5b3e8edaa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:39:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] No waiting events found dispatching network-vif-plugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:39:38 user nova-compute[75257]: WARNING nova.compute.manager [req-0e936b07-aeb4-4212-9a48-0d18e09734e3 req-96dfc1a2-1d42-4561-a756-a467f959b262 service nova] [instance: 7a919147-feb1-4f0b-9571-f5b3e8edaa59] Received unexpected event network-vif-plugged-dd39e651-4371-4f6c-9ddf-1f8aeed0c400 for instance with vm_state deleted and task_state None.
Nov 14 02:39:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:39:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:39:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:39:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:40:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:40:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:40:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:40:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:40:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:40:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:40:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:40:18 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:40:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:19 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:40:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:40:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:40:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:40:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:40:23 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:40:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:40:24 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:40:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9169MB free_disk=25.13031768798828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:40:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:40:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:40:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:40:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:40:24 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:40:24 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:40:24 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:40:24 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:40:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:40:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:40:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:40:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:40:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:27 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:40:40 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:40:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:40:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:40:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:41:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:41:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:41:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:41:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:41:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:41:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:41:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:41:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:41:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:41:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:41:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:41:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:22 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:24 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:25 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:41:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:41:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:41:25 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:41:26 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:41:26 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:41:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9195MB free_disk=25.11974334716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:41:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:41:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:41:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:41:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:41:26 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:41:26 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:41:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:41:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:41:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:28 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.compute.claims [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Claim successful on node user
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.policy [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14b78c0b5e3b4e9f826162a9e17ca8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4669185f0a240bda390f3dfd67e3144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.block_device [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Booting with volume 54e9e8d7-718b-49aa-97f6-f175733eacfc at /dev/vda
Nov 14 02:41:44 user nova-compute[75257]: DEBUG os_brick.utils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c090c842-7a54-4861-9849-1bcaa2686b2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad76cd8f-0c4e-4cfe-af50-0427e2757f90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbb4958-e5f8-4fa7-93ca-5a3787b15ff2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e959b1-f545-44e7-92fa-d046d7033733]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:41:44 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:41:44 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f51e6f-abdd-40ea-b023-9983173ebf0e]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG os_brick.utils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating existing volume attachment record: ce4cea8f-19f1-4897-b4eb-ecfc2de1f615 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Verify base images {{(pid=75257) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75257) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520
Nov 14 02:41:44 user nova-compute[75257]: WARNING nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Removable base files: /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8 /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371 /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951 /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33 /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33 /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8 /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520 /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6255c22f7207f2c5105de06f2e1fb3bc9ba956c8
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf8abcabff02423123d9fd8d2c3744cd075a3371
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/376aa244a68ca860f6ec663a4ad5548892ac1951
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5bb10a1c0a37b862cc07a721c28c0924f415347c
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0a0f0b44b35631f29214d20f37eb8557e1d22d33
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/38848b412b91d7deae65738c5fae7b5faeeaec33
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b157ccf57fd98c7fe7301ed7e52eb8f4702c66c8
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d1ff3ee4fc4483ee163048e596e4be31d671520
Nov 14 02:41:44 user nova-compute[75257]: INFO nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d60a08f4533bd589e292cba83e4ac3bd240df23d
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Verification complete {{(pid=75257) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Verify swap images {{(pid=75257) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 02:41:44 user nova-compute[75257]: DEBUG nova.virt.libvirt.imagecache [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Verify ephemeral images {{(pid=75257) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Successfully created port: 4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Successfully updated port: 4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG nova.compute.manager [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing instance network info cache due to event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG nova.network.neutron [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Instance network_info: |[{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:41:45 user nova-compute[75257]: DEBUG nova.network.neutron [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:41:46 user nova-compute[75257]: DEBUG nova.network.neutron [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updated VIF entry in instance network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:41:46 user nova-compute[75257]: DEBUG nova.network.neutron [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:41:46 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-39e24e30-c8c6-4023-aa8b-09b76a6945d2 req-3e6c320c-72a2-4cf6-b00b-86621ad12964 service nova] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:41:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:41:48 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Creating image(s)
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Ensure instance console log exists: /opt/stack/data/nova/instances/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Start _get_guest_xml network_info=[{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ce4cea8f-19f1-4897-b4eb-ecfc2de1f615', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhPZjGIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0', 'attached_at': '', 'detached_at': '', 'volume_id': '54e9e8d7-718b-49aa-97f6-f175733eacfc', 'serial': '54e9e8d7-718b-49aa-97f6-f175733eacfc'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:41:48 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:41:48 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhPZjGIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:41:48 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:41:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:41:48 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:41:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:41:48 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c0db3f-46c3-41c6-bfda-e00ae5dbbbb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:41:48 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d855c918-e834-49ba-aa77-fbf6f2c75821]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc] added
Nov 14 02:41:48 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:41:48 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd093161-97c4-4df1-b888-929a17546e72]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb60391-de17-4424-8702-95966fab9f95]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhPZjGIR {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhPZjGIR" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d558de-c176-49fb-b485-9082a5265e67]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zhPZjGIR'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[923e57da-4942-42aa-92ff-cbbcbc0472da]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c005494-0fa9-46b4-a172-6b9630d707f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:41:49 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:41:49 user nova-compute[75257]:  {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:41:49 user nova-compute[75257]: WARNING os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 02:41:49 user nova-compute[75257]: 
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8108da-a7f2-4730-abc0-eddf64368785]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260]
Nov 14 02:41:49 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260] successful.
Nov 14 02:41:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5248851-6534-49d5-b5bf-3189db70afad]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a58f0d6-d8c5-420c-9f68-bb46f71f3a7d]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)
Nov 14 02:41:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)
Nov 14 02:41:49 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d789a9b7-f21d-47b7-9449-f3b126c6c40c]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:41:49 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhPZjGIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26363633864303333', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363633864303333', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1225809098',display_name='tempest-TestShelveInstance-server-1225809098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1225809098',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0mk3N2i+vDUBlc+/tR7tW4k+Hjxc54ts/bXTLbzJJIp+qzJkzPf9i3LPF9l/pgKd1pjqRhsKai74htofsle53vM8QNltKsuYG+hkntScDGvtmWRDNYiiKOJZv0tYctKQ==',key_name='tempest-TestShelveInstance-25028662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4669185f0a240bda390f3dfd67e3144',ramdisk_id='',reservation_id='r-vzypo7rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-872244517',owner_user_name='tempest-TestShelveInstance-872244517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:41:44Z,user_data=None,user_id='14b78c0b5e3b4e9f826162a9e17ca8bb',uuid=a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converting VIF {"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.objects.instance [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lazy-loading 'pci_devices' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:41:50 user nova-compute[75257]:   <uuid>a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0</uuid>
Nov 14 02:41:50 user nova-compute[75257]:   <name>instance-00000034</name>
Nov 14 02:41:50 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:41:50 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:41:50 user nova-compute[75257]:   <metadata>
Nov 14 02:41:50 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:41:50 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:41:50 user nova-compute[75257]:       <nova:name>tempest-TestShelveInstance-server-1225809098</nova:name>
Nov 14 02:41:50 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:41:48</nova:creationTime>
Nov 14 02:41:50 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:41:50 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:41:50 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:41:50 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:41:50 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:41:50 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:41:50 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:41:50 user nova-compute[75257]:       <nova:owner>
Nov 14 02:41:50 user nova-compute[75257]:         <nova:user uuid="14b78c0b5e3b4e9f826162a9e17ca8bb">tempest-TestShelveInstance-872244517-project-member</nova:user>
Nov 14 02:41:50 user nova-compute[75257]:         <nova:project uuid="e4669185f0a240bda390f3dfd67e3144">tempest-TestShelveInstance-872244517</nova:project>
Nov 14 02:41:50 user nova-compute[75257]:       </nova:owner>
Nov 14 02:41:50 user nova-compute[75257]:       <nova:ports>
Nov 14 02:41:50 user nova-compute[75257]:         <nova:port uuid="4a97df88-0ca9-4a23-878d-0f9377845397">
Nov 14 02:41:50 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 02:41:50 user nova-compute[75257]:         </nova:port>
Nov 14 02:41:50 user nova-compute[75257]:       </nova:ports>
Nov 14 02:41:50 user nova-compute[75257]:     </nova:instance>
Nov 14 02:41:50 user nova-compute[75257]:   </metadata>
Nov 14 02:41:50 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:41:50 user nova-compute[75257]:     <system>
Nov 14 02:41:50 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:41:50 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:41:50 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:41:50 user nova-compute[75257]:       <entry name="serial">a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0</entry>
Nov 14 02:41:50 user nova-compute[75257]:       <entry name="uuid">a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0</entry>
Nov 14 02:41:50 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:41:50 user nova-compute[75257]:     </system>
Nov 14 02:41:50 user nova-compute[75257]:   </sysinfo>
Nov 14 02:41:50 user nova-compute[75257]:   <os>
Nov 14 02:41:50 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:41:50 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:41:50 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:41:50 user nova-compute[75257]:   </os>
Nov 14 02:41:50 user nova-compute[75257]:   <features>
Nov 14 02:41:50 user nova-compute[75257]:     <acpi/>
Nov 14 02:41:50 user nova-compute[75257]:     <apic/>
Nov 14 02:41:50 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:41:50 user nova-compute[75257]:   </features>
Nov 14 02:41:50 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:41:50 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:41:50 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:41:50 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:41:50 user nova-compute[75257]:   </clock>
Nov 14 02:41:50 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:41:50 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:41:50 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:41:50 user nova-compute[75257]:   </cpu>
Nov 14 02:41:50 user nova-compute[75257]:   <devices>
Nov 14 02:41:50 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:41:50 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:41:50 user nova-compute[75257]:       <source dev="/dev/sdb"/>
Nov 14 02:41:50 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:41:50 user nova-compute[75257]:       <serial>54e9e8d7-718b-49aa-97f6-f175733eacfc</serial>
Nov 14 02:41:50 user nova-compute[75257]:     </disk>
Nov 14 02:41:50 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:41:50 user nova-compute[75257]:       <mac address="fa:16:3e:a1:4e:ab"/>
Nov 14 02:41:50 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:41:50 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:41:50 user nova-compute[75257]:       <target dev="tap4a97df88-0c"/>
Nov 14 02:41:50 user nova-compute[75257]:     </interface>
Nov 14 02:41:50 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:41:50 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/console.log" append="off"/>
Nov 14 02:41:50 user nova-compute[75257]:     </serial>
Nov 14 02:41:50 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:41:50 user nova-compute[75257]:     <video>
Nov 14 02:41:50 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:41:50 user nova-compute[75257]:     </video>
Nov 14 02:41:50 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:41:50 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:41:50 user nova-compute[75257]:     </rng>
Nov 14 02:41:50 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:41:50 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:41:50 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:41:50 user nova-compute[75257]:     </memballoon>
Nov 14 02:41:50 user nova-compute[75257]:   </devices>
Nov 14 02:41:50 user nova-compute[75257]: </domain>
Nov 14 02:41:50 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1225809098',display_name='tempest-TestShelveInstance-server-1225809098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1225809098',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0mk3N2i+vDUBlc+/tR7tW4k+Hjxc54ts/bXTLbzJJIp+qzJkzPf9i3LPF9l/pgKd1pjqRhsKai74htofsle53vM8QNltKsuYG+hkntScDGvtmWRDNYiiKOJZv0tYctKQ==',key_name='tempest-TestShelveInstance-25028662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4669185f0a240bda390f3dfd67e3144',ramdisk_id='',reservation_id='r-vzypo7rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-872244517',owner_user_name='tempest-TestShelveInstance-872244517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:41:44Z,user_data=None,user_id='14b78c0b5e3b4e9f826162a9e17ca8bb',uuid=a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converting VIF {"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG os_vif [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f860d062-03ca-589d-a1ce-d027195cb321', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a97df88-0c, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a97df88-0c, col_values=(('qos', UUID('52604c47-e34b-4cd9-981c-fa2e3e1dd39b')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a97df88-0c, col_values=(('external_ids', {'iface-id': '4a97df88-0ca9-4a23-878d-0f9377845397', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:4e:ab', 'vm-uuid': 'a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:50 user nova-compute[75257]: INFO os_vif [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c')
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:41:50 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] No VIF found with MAC fa:16:3e:a1:4e:ab, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:41:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:41:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:41:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:41:52 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:41:52 user nova-compute[75257]: DEBUG nova.compute.manager [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] No waiting events found dispatching network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:41:52 user nova-compute[75257]: WARNING nova.compute.manager [req-6c55055c-0c96-4ca5-bddd-83a381cdf578 req-4656de48-1039-462b-959e-a9fc5f6999b9 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received unexpected event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 for instance with vm_state building and task_state spawning.
Nov 14 02:41:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:41:53 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Instance spawned successfully.
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:41:53 user nova-compute[75257]: INFO nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 14 02:41:53 user nova-compute[75257]: DEBUG nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:41:54 user nova-compute[75257]: INFO nova.compute.manager [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Took 9.96 seconds to build instance.
Nov 14 02:41:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:41:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:41:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:41:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:41:54 user nova-compute[75257]: DEBUG nova.compute.manager [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] No waiting events found dispatching network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:41:54 user nova-compute[75257]: WARNING nova.compute.manager [req-c3409d0b-0592-4d47-a52a-c0d9e1d90a98 req-bf70ca84-9190-432b-924e-2d8ff0dc1d7f service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received unexpected event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 for instance with vm_state active and task_state None.
Nov 14 02:41:54 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-e0faa3a0-83ee-4dd1-9858-ae6e554640c0 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.056s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:41:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:41:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:12 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:42:20 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:42:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:42:20 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:42:20 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:42:20 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:42:21 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:42:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:42:21 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:42:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:21 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:42:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:24 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:25 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:42:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:42:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:42:25 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:42:25 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:42:26 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:42:26 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=25.116863250732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:42:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:42:28 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:28 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:42:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:42:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:42:42 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:43 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:43 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:42:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:42:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:42:43 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:42:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:42:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:42:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:42:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:42:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:45 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:42:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:42:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:42:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:42:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:42:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:42:57 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:42:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:42:57 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:43:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:43:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:13 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:43:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:43:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:43:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:22 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:43:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:43:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:43:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:43:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:43:22 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:43:22 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:43:23 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:43:23 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:43:23 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:43:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:43:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:43:23 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:43:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:25 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:43:25 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:43:26 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:43:26 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:43:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:43:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:43:26 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:43:26 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:43:26 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:43:27 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:43:27 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:43:27 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=25.116310119628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:43:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:43:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:43:27 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:43:27 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:43:27 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:43:27 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:43:27 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:43:27 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:43:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:43:30 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:43:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:43:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:43:35 user nova-compute[75257]: DEBUG nova.compute.manager [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing instance network info cache due to event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:43:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:43:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:43:35 user nova-compute[75257]: DEBUG nova.network.neutron [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updated VIF entry in instance network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG nova.network.neutron [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0aeb3e00-38e8-4516-97a1-235e7b12a124 req-96836d20-7aba-452c-ac9a-fa78f5f24a72 service nova] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:43:36 user nova-compute[75257]: INFO nova.compute.manager [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Shelve offloading
Nov 14 02:43:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-unplugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:43:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] No waiting events found dispatching network-vif-unplugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:43:36 user nova-compute[75257]: WARNING nova.compute.manager [req-bd8746c5-7a7c-4cb8-9067-dc875f6a9998 req-10025749-859c-4a76-84b7-1d895bb81997 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received unexpected event network-vif-unplugged-4a97df88-0ca9-4a23-878d-0f9377845397 for instance with vm_state active and task_state shelving.
Nov 14 02:43:37 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Instance destroyed successfully.
Nov 14 02:43:37 user nova-compute[75257]: DEBUG nova.compute.manager [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG nova.network.neutron [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG nova.network.neutron [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:37 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Instance destroyed successfully.
Nov 14 02:43:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lazy-loading 'resources' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1225809098',display_name='tempest-TestShelveInstance-server-1225809098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1225809098',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0mk3N2i+vDUBlc+/tR7tW4k+Hjxc54ts/bXTLbzJJIp+qzJkzPf9i3LPF9l/pgKd1pjqRhsKai74htofsle53vM8QNltKsuYG+hkntScDGvtmWRDNYiiKOJZv0tYctKQ==',key_name='tempest-TestShelveInstance-25028662',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4669185f0a240bda390f3dfd67e3144',ramdisk_id='',reservation_id='r-vzypo7rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-872244517',owner_user_name='tempest-TestShelveInstance-872244517-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:41:54Z,user_data=None,user_id='14b78c0b5e3b4e9f826162a9e17ca8bb',uuid=a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converting VIF {"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG os_vif [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a97df88-0c, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52604c47-e34b-4cd9-981c-fa2e3e1dd39b) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:37 user nova-compute[75257]: INFO os_vif [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c')
Nov 14 02:43:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhPZjGIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:43:37 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:43:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baa2413-dabc-4618-a008-a9f322f87083]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:43:37 user nova-compute[75257]: No targets found.
Nov 14 02:43:37 user nova-compute[75257]: iSNS:
Nov 14 02:43:37 user nova-compute[75257]: No targets found.
Nov 14 02:43:37 user nova-compute[75257]: STATIC:
Nov 14 02:43:37 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc
Nov 14 02:43:37 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:43:37 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:43:37 user nova-compute[75257]: FIRMWARE:
Nov 14 02:43:37 user nova-compute[75257]: No targets found.
Nov 14 02:43:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:43:37 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:43:37 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:43:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8e905c-fcb8-43ea-be7b-402a0a48e1ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[810a0bd7-e045-473b-8149-387c96c1ae96]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)
Nov 14 02:43:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)
Nov 14 02:43:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a43104c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c830f53-9acd-40c4-ac9f-c2ded8e2835c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6957a8fe-ef34-4d43-aa86-0eb21e647e93]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[724c8396-e3f7-466f-adef-309b60b961ad]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0076698f-d0f1-41fc-b674-ffa1fab7ff65]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[633075e8-9d2d-4e4f-b728-c44053434443]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa147d-a293-4169-81d8-b8e0dd594d93]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260]
Nov 14 02:43:38 user nova-compute[75257]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260] successful.
Nov 14 02:43:38 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb60168-032e-4277-b68e-86c04bcea4be]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] <== disconnect_volume: return (287ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:43:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Deleting instance files /opt/stack/data/nova/instances/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0_del
Nov 14 02:43:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Deletion of /opt/stack/data/nova/instances/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0_del complete
Nov 14 02:43:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] No waiting events found dispatching network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:43:38 user nova-compute[75257]: WARNING nova.compute.manager [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received unexpected event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 for instance with vm_state active and task_state shelving.
Nov 14 02:43:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing instance network info cache due to event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG nova.network.neutron [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG nova.network.neutron [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updated VIF entry in instance network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG nova.network.neutron [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": null, "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4a97df88-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:43:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b4faad78-9133-4938-b035-0a04c9d5bb23 req-4b0744f0-1567-482f-82ed-de306be23266 service nova] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:43:39 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Deleted allocations for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0
Nov 14 02:43:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:43:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:43:39 user nova-compute[75257]: DEBUG nova.objects.instance [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lazy-loading 'numa_topology' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:43:39 user nova-compute[75257]: DEBUG nova.objects.base [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Object Instance<a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0> lazy-loaded attributes: resources,numa_topology {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:43:39 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:43:39 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:43:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.093s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:43:39 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-3229fe0c-5e3c-4d89-bfc0-4e05e14a80d9 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.212s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:43:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:43:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:43:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:43:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:43:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:43:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:44:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:44:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:44:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:15 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:44:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:23 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:23 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:44:24 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:26 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:27 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:27 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:44:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:44:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:44:27 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:44:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:44:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:44:28 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9174MB free_disk=25.107662200927734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:44:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:44:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:44:28 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:44:28 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:44:28 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:44:28 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:44:28 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:44:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:44:29 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:30 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:44:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:44:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:44:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:44:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:44:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:44:38 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:44:42 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:44:43 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:48 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:44:58 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:03 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:45:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:45:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:45:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:45:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:45:22 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:45:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:45:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:45:22 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:45:23 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:25 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:45:25 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:45:26 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:45:27 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:45:27 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:45:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:45:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:45:27 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:45:27 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:45:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:45:28 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:45:28 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9191MB free_disk=25.107067108154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:45:28 user nova-compute[75257]: INFO nova.compute.manager [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Unshelving
Nov 14 02:45:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:28 user nova-compute[75257]: INFO nova.virt.block_device [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Booting with volume 54e9e8d7-718b-49aa-97f6-f175733eacfc at /dev/vda
Nov 14 02:45:28 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG os_brick.utils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce96c47-d9e1-4210-a2f5-000f13dde51c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c769c032-27cd-4903-ac43-ecf8fb598665]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a33d76-3dee-46c6-a10d-77c1b5c277cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe71a010-e618-46a2-b403-66dc3d71dfcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:45:28 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:45:28 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d574fe39-1365-43f5-9923-950651bd5654]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG os_brick.utils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:45:28 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating existing volume attachment record: 066d50df-081b-47e5-9195-1d130859faf6 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:45:29 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:45:29 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:45:31 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:45:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:45:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:45:32 user nova-compute[75257]: DEBUG nova.objects.instance [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lazy-loading 'pci_requests' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:45:32 user nova-compute[75257]: DEBUG nova.objects.instance [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lazy-loading 'numa_topology' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:45:32 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:45:32 user nova-compute[75257]: INFO nova.compute.claims [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Claim successful on node user
Nov 14 02:45:32 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:45:32 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:45:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:45:32 user nova-compute[75257]: INFO nova.network.neutron [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating port 4a97df88-0ca9-4a23-878d-0f9377845397 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 02:45:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.network.neutron [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.compute.manager [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.compute.manager [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing instance network info cache due to event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.network.neutron [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:45:33 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Creating image(s)
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Did not create local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Ensure instance console log exists: /opt/stack/data/nova/instances/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Start _get_guest_xml network_info=[{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '066d50df-081b-47e5-9195-1d130859faf6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhPZjGIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0', 'attached_at': '', 'detached_at': '', 'volume_id': '54e9e8d7-718b-49aa-97f6-f175733eacfc', 'serial': '54e9e8d7-718b-49aa-97f6-f175733eacfc'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.network.neutron [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:45:33 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:45:33 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.objects.instance [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lazy-loading 'vcpu_model' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.objects.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Object Instance<a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhPZjGIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:45:33 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:45:33 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:45:33 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a859c72d-976d-4f4c-94b4-de7345eae802]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:45:33 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8f0ec-2486-4133-93f6-849101e84413]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc] added
Nov 14 02:45:33 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2737d91d-c819-44f8-9e58-b1f9a3003ef8]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf71629-feab-43e9-aeb5-a2a551e64fa4]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhPZjGIR {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhPZjGIR" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4622ecb-8fd4-4318-b53b-321e22e918e2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zhPZjGIR'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cc6ba2-69aa-4f25-b666-5eeb9a111acb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcdeb3c-c1e3-4ea3-b8a1-5b1fc7d6c9e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:45:33 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:45:33 user nova-compute[75257]:  {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:45:33 user nova-compute[75257]: WARNING os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 02:45:33 user nova-compute[75257]: 
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02ff1e9-7c8e-4083-910f-73e48f3f7647]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260]
Nov 14 02:45:33 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260] successful.
Nov 14 02:45:33 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb03687-dc91-4862-a380-c4cf1e63af9a]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d93275-e99b-4807-a156-12d32fae2e1c]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)
Nov 14 02:45:33 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)
Nov 14 02:45:33 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:45:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:45:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:45:34 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[59796297-e426-4e69-af60-19530fcc66b0]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:45:34 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:45:34 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhPZjGIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:45:34 user nova-compute[75257]: DEBUG nova.network.neutron [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updated VIF entry in instance network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:45:34 user nova-compute[75257]: DEBUG nova.network.neutron [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:45:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-b840d5d8-4bf8-4af3-a859-754120ee443a req-a2537daa-ba9e-4003-86b2-d98a50e04902 service nova] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26363633864303333', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363633864303333', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1225809098',display_name='tempest-TestShelveInstance-server-1225809098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1225809098',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-25028662',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e4669185f0a240bda390f3dfd67e3144',ramdisk_id='',reservation_id='r-vzypo7rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-872244517',owner_user_name='tempest-TestShelveInstance-872244517-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:45:28Z,user_data=None,user_id='14b78c0b5e3b4e9f826162a9e17ca8bb',uuid=a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converting VIF {"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.objects.instance [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lazy-loading 'pci_devices' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.objects.base [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Object Instance<a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75257) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:45:35 user nova-compute[75257]:   <uuid>a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0</uuid>
Nov 14 02:45:35 user nova-compute[75257]:   <name>instance-00000034</name>
Nov 14 02:45:35 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:45:35 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:45:35 user nova-compute[75257]:   <metadata>
Nov 14 02:45:35 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:45:35 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:45:35 user nova-compute[75257]:       <nova:name>tempest-TestShelveInstance-server-1225809098</nova:name>
Nov 14 02:45:35 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:45:33</nova:creationTime>
Nov 14 02:45:35 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:45:35 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:45:35 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:45:35 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:45:35 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:45:35 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:45:35 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:45:35 user nova-compute[75257]:       <nova:owner>
Nov 14 02:45:35 user nova-compute[75257]:         <nova:user uuid="14b78c0b5e3b4e9f826162a9e17ca8bb">tempest-TestShelveInstance-872244517-project-member</nova:user>
Nov 14 02:45:35 user nova-compute[75257]:         <nova:project uuid="e4669185f0a240bda390f3dfd67e3144">tempest-TestShelveInstance-872244517</nova:project>
Nov 14 02:45:35 user nova-compute[75257]:       </nova:owner>
Nov 14 02:45:35 user nova-compute[75257]:       <nova:ports>
Nov 14 02:45:35 user nova-compute[75257]:         <nova:port uuid="4a97df88-0ca9-4a23-878d-0f9377845397">
Nov 14 02:45:35 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 02:45:35 user nova-compute[75257]:         </nova:port>
Nov 14 02:45:35 user nova-compute[75257]:       </nova:ports>
Nov 14 02:45:35 user nova-compute[75257]:     </nova:instance>
Nov 14 02:45:35 user nova-compute[75257]:   </metadata>
Nov 14 02:45:35 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:45:35 user nova-compute[75257]:     <system>
Nov 14 02:45:35 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:45:35 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:45:35 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:45:35 user nova-compute[75257]:       <entry name="serial">a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0</entry>
Nov 14 02:45:35 user nova-compute[75257]:       <entry name="uuid">a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0</entry>
Nov 14 02:45:35 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:45:35 user nova-compute[75257]:     </system>
Nov 14 02:45:35 user nova-compute[75257]:   </sysinfo>
Nov 14 02:45:35 user nova-compute[75257]:   <os>
Nov 14 02:45:35 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:45:35 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:45:35 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:45:35 user nova-compute[75257]:   </os>
Nov 14 02:45:35 user nova-compute[75257]:   <features>
Nov 14 02:45:35 user nova-compute[75257]:     <acpi/>
Nov 14 02:45:35 user nova-compute[75257]:     <apic/>
Nov 14 02:45:35 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:45:35 user nova-compute[75257]:   </features>
Nov 14 02:45:35 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:45:35 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:45:35 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:45:35 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:45:35 user nova-compute[75257]:   </clock>
Nov 14 02:45:35 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:45:35 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:45:35 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:45:35 user nova-compute[75257]:   </cpu>
Nov 14 02:45:35 user nova-compute[75257]:   <devices>
Nov 14 02:45:35 user nova-compute[75257]:     <disk type="block" device="disk">
Nov 14 02:45:35 user nova-compute[75257]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:45:35 user nova-compute[75257]:       <source dev="/dev/sdb"/>
Nov 14 02:45:35 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:45:35 user nova-compute[75257]:       <serial>54e9e8d7-718b-49aa-97f6-f175733eacfc</serial>
Nov 14 02:45:35 user nova-compute[75257]:     </disk>
Nov 14 02:45:35 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:45:35 user nova-compute[75257]:       <mac address="fa:16:3e:a1:4e:ab"/>
Nov 14 02:45:35 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:45:35 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:45:35 user nova-compute[75257]:       <target dev="tap4a97df88-0c"/>
Nov 14 02:45:35 user nova-compute[75257]:     </interface>
Nov 14 02:45:35 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:45:35 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0/console.log" append="off"/>
Nov 14 02:45:35 user nova-compute[75257]:     </serial>
Nov 14 02:45:35 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:45:35 user nova-compute[75257]:     <video>
Nov 14 02:45:35 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:45:35 user nova-compute[75257]:     </video>
Nov 14 02:45:35 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:45:35 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:45:35 user nova-compute[75257]:     </rng>
Nov 14 02:45:35 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:45:35 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:45:35 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:45:35 user nova-compute[75257]:     </memballoon>
Nov 14 02:45:35 user nova-compute[75257]:   </devices>
Nov 14 02:45:35 user nova-compute[75257]: </domain>
Nov 14 02:45:35 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1225809098',display_name='tempest-TestShelveInstance-server-1225809098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1225809098',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-25028662',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e4669185f0a240bda390f3dfd67e3144',ramdisk_id='',reservation_id='r-vzypo7rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-872244517',owner_user_name='tempest-TestShelveInstance-872244517-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:45:28Z,user_data=None,user_id='14b78c0b5e3b4e9f826162a9e17ca8bb',uuid=a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converting VIF {"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG os_vif [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f860d062-03ca-589d-a1ce-d027195cb321', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a97df88-0c, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a97df88-0c, col_values=(('qos', UUID('569f88b3-0b42-49de-8bb1-a1ec672eda5f')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a97df88-0c, col_values=(('external_ids', {'iface-id': '4a97df88-0ca9-4a23-878d-0f9377845397', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:4e:ab', 'vm-uuid': 'a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:35 user nova-compute[75257]: INFO os_vif [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c')
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:45:35 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] No VIF found with MAC fa:16:3e:a1:4e:ab, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG nova.compute.manager [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] No waiting events found dispatching network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:45:36 user nova-compute[75257]: WARNING nova.compute.manager [req-0da8f600-7ade-4235-9131-dd7e8ec6d00d req-e2a4fbff-44aa-4149-9059-c0eb711e8065 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received unexpected event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 02:45:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:38 user nova-compute[75257]: DEBUG nova.compute.manager [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:45:38 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:45:38 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Instance spawned successfully.
Nov 14 02:45:38 user nova-compute[75257]: DEBUG nova.compute.manager [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:45:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-903d3849-8dab-4f14-a265-39d36bf14312 tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.515s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:45:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:45:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:45:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:45:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:45:38 user nova-compute[75257]: DEBUG nova.compute.manager [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] No waiting events found dispatching network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:45:38 user nova-compute[75257]: WARNING nova.compute.manager [req-bc9abc59-ff10-4bf2-9cad-5cb13c3648ed req-cc633e5d-dc44-41c6-8ae5-591114aab568 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received unexpected event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 for instance with vm_state active and task_state None.
Nov 14 02:45:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:45:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:46:24 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:46:24 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:25 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:46:26 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:28 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:29 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:29 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:46:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:46:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:46:29 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:46:29 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75257) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:46:30 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:46:30 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:46:30 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=25.105541229248047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:46:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:46:32 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:32 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:46:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:46:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:46:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:46:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:46:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:47:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing instance network info cache due to event network-changed-4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] Acquiring lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] Acquired lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.network.neutron [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Refreshing network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:47:19 user nova-compute[75257]: INFO nova.compute.manager [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Terminating instance
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.compute.manager [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-unplugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] No waiting events found dispatching network-vif-unplugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-2e84f156-4230-4600-8a8b-447c7bf5c654 req-6e60ab92-1365-4921-994d-e31f879b0bd0 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-unplugged-4a97df88-0ca9-4a23-878d-0f9377845397 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.network.neutron [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updated VIF entry in instance network info cache for port 4a97df88-0ca9-4a23-878d-0f9377845397. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.network.neutron [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [{"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-70d43dd5-be3e-4455-9519-a1fed16adc49 req-6101b6d8-aa29-4c4f-8bb9-5be9aff469c5 service nova] Releasing lock "refresh_cache-a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:47:19 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Instance destroyed successfully.
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.objects.instance [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lazy-loading 'resources' on Instance uuid a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T02:41:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1225809098',display_name='tempest-TestShelveInstance-server-1225809098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1225809098',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0mk3N2i+vDUBlc+/tR7tW4k+Hjxc54ts/bXTLbzJJIp+qzJkzPf9i3LPF9l/pgKd1pjqRhsKai74htofsle53vM8QNltKsuYG+hkntScDGvtmWRDNYiiKOJZv0tYctKQ==',key_name='tempest-TestShelveInstance-25028662',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4669185f0a240bda390f3dfd67e3144',ramdisk_id='',reservation_id='r-vzypo7rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-872244517',owner_user_name='tempest-TestShelveInstance-872244517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:45:39Z,user_data=None,user_id='14b78c0b5e3b4e9f826162a9e17ca8bb',uuid=a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converting VIF {"id": "4a97df88-0ca9-4a23-878d-0f9377845397", "address": "fa:16:3e:a1:4e:ab", "network": {"id": "76e82c84-1e7b-498a-b1c2-3441bd656ce4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1364779842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4669185f0a240bda390f3dfd67e3144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a97df88-0c", "ovs_interfaceid": "4a97df88-0ca9-4a23-878d-0f9377845397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG os_vif [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a97df88-0c, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=569f88b3-0b42-49de-8bb1-a1ec672eda5f) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:47:19 user nova-compute[75257]: INFO os_vif [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:4e:ab,bridge_name='br-int',has_traffic_filtering=True,id=4a97df88-0ca9-4a23-878d-0f9377845397,network=Network(76e82c84-1e7b-498a-b1c2-3441bd656ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a97df88-0c')
Nov 14 02:47:19 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhPZjGIR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:47:19 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:47:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a6b5dd-1d90-4836-97ed-9fc0c6152910]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:47:19 user nova-compute[75257]: No targets found.
Nov 14 02:47:19 user nova-compute[75257]: iSNS:
Nov 14 02:47:19 user nova-compute[75257]: No targets found.
Nov 14 02:47:19 user nova-compute[75257]: STATIC:
Nov 14 02:47:19 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc
Nov 14 02:47:19 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:47:19 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:47:19 user nova-compute[75257]: FIRMWARE:
Nov 14 02:47:19 user nova-compute[75257]: No targets found.
Nov 14 02:47:19 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:47:19 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:47:19 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:19 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd92fca4-0b40-4df6-803e-93b3dc72384c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f58ef08-c0b0-4a10-9a38-8af7728788c9]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)
Nov 14 02:47:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc (non-flash)
Nov 14 02:47:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb9a4374430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4a8b6-4014-4b34-8067-f0665f7a48d8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c14153-7123-42ca-af58-15938162f784]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a7b8ea-8ee8-416a-aa0e-de0a788ee0ae]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4970a272-0e9b-42a8-b403-9394b0576b4d]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26363633864303333', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9774b006', '/dev/disk/by-id/scsi-1SCST_BIO9774b006-ccc8d03394dffa52') {{(pid=85764) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcd7dd7-7ac4-4b24-917b-ae818d8474e7]: (4, None) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a83ee0-6b9d-4919-9f75-c3c144292bef]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77fc5ce-925c-4a9f-8015-951d961a4518]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260]
Nov 14 02:47:20 user nova-compute[75257]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc, portal: 172.16.0.220,3260] successful.
Nov 14 02:47:20 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54e9e8d7-718b-49aa-97f6-f175733eacfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07e8af2-bc9a-4509-b7eb-6863945fa11e]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] <== disconnect_volume: return (298ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:47:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Deleting instance files /opt/stack/data/nova/instances/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0_del
Nov 14 02:47:20 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Deletion of /opt/stack/data/nova/instances/a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0_del complete
Nov 14 02:47:20 user nova-compute[75257]: INFO nova.compute.manager [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 02:47:20 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:47:20 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:47:20 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Took 0.52 seconds to deallocate network for instance.
Nov 14 02:47:21 user nova-compute[75257]: INFO nova.compute.manager [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Took 0.86 seconds to detach 1 volumes for instance.
Nov 14 02:47:21 user nova-compute[75257]: DEBUG nova.compute.manager [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Deleting volume: 54e9e8d7-718b-49aa-97f6-f175733eacfc {{(pid=75257) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] Acquiring lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] No waiting events found dispatching network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:47:21 user nova-compute[75257]: WARNING nova.compute.manager [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received unexpected event network-vif-plugged-4a97df88-0ca9-4a23-878d-0f9377845397 for instance with vm_state active and task_state deleting.
Nov 14 02:47:21 user nova-compute[75257]: DEBUG nova.compute.manager [req-e5dc2ab2-09c1-4b98-8e0e-109b54e35d5d req-3d2f44f1-8699-4661-9ae1-f8a26206522b service nova] [instance: a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0] Received event network-vif-deleted-4a97df88-0ca9-4a23-878d-0f9377845397 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:47:21 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:47:22 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Deleted allocations for instance a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0
Nov 14 02:47:22 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-03742ed2-a275-42ea-9c9a-37b01698951f tempest-TestShelveInstance-872244517 tempest-TestShelveInstance-872244517-project-member] Lock "a1491cd6-32ce-4631-a0e0-cbd2b27ab3a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.977s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:47:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:24 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:25 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:25 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:47:25 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:47:25 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:47:27 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:27 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:27 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:47:28 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:29 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:30 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:47:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:47:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:47:30 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:47:31 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:47:31 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9149MB free_disk=25.10477066040039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:47:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:47:32 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:32 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:33 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:47:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:47:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:47:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:47:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:39 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:47:44 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:49 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:47:55 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:47:55 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:47:59 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:48:04 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:48:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:10 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:48:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:48:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:14 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:15 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:48:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:48:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:48:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:48:20 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:25 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:26 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:48:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:48:26 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:48:27 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:28 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:48:30 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:48:30 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:30 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:48:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:48:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:48:30 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:48:30 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:48:30 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:48:30 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9297MB free_disk=25.103092193603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:48:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:48:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:48:31 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:48:31 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:48:31 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:48:31 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:48:31 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:48:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:48:34 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:34 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:34 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:35 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:48:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:48:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:48:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:48:40 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:45 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:48:45 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:48:50 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:53 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:54 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:55 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:48:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:00 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:05 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Starting instance... {{(pid=75257) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75257) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 02:49:08 user nova-compute[75257]: INFO nova.compute.claims [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Claim successful on node user
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Start building networks asynchronously for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Allocating IP information in the background. {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.network.neutron [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] allocate_for_instance() {{(pid=75257) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 02:49:08 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Start building block device mappings for instance. {{(pid=75257) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.policy [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4bd8164c6734205b8e41e74b0ce832e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d92f0c85bd4b20a76d315b1fff8f81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75257) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Start spawning the instance on the hypervisor. {{(pid=75257) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Creating instance directory {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 02:49:08 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Creating image(s)
Nov 14 02:49:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "/opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "/opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "/opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:49:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.181s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.225s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk 1073741824 {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66,backing_fmt=raw /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk 1073741824" returned: 0 in 0.054s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce2f0dbbb1e86cc31d40fbdfce96fb65c1290d66 --force-share --output=json" returned: 0 in 0.207s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk. size=1073741824 {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG nova.network.neutron [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Successfully created port: 10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG nova.virt.disk.api [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Cannot resize image /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk to a smaller size. {{(pid=75257) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Created local disks {{(pid=75257) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Ensure instance console log exists: /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/console.log {{(pid=75257) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:49:09 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Successfully updated port: 10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquired lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Building network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received event network-changed-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG nova.compute.manager [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Refreshing instance network info cache due to event network-changed-10c48d81-cc93-41f7-93b5-8ec30223a387. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] Acquiring lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Instance cache missing network info. {{(pid=75257) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG nova.network.neutron [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Releasing lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Instance network_info: |[{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75257) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] Acquired lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG nova.network.neutron [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Refreshing network info cache for port 10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:49:10 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Start _get_guest_xml network_info=[{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ccff493f-43f6-4683-9bdc-984e861f9bf9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 02:49:11 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:49:11 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] CPU controller missing on host. {{(pid=75257) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.host [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] CPU controller found on host. {{(pid=75257) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75257) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T02:02:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T02:02:13Z,direct_url=<?>,disk_format='qcow2',id=ccff493f-43f6-4683-9bdc-984e861f9bf9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='287183b1322b4e14bb1529cf4b1622c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T02:02:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Flavor limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Image limits 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Flavor pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Image pref 0:0:0 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Got 1 possible topologies {{(pid=75257) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.hardware [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75257) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:49:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1804523011',display_name='tempest-SnapshotDataIntegrityTests-server-1804523011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1804523011',id=53,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/2/dChEzGh99fomls9GfeKvtqveWShI3UeXT2IxIahh0o6gchHk+4rIR33V5V196DsPnNW6gCOEJAbpSTc5tdg71kK0o80z4NtrbrY33vPOdAh40qhkOOrdLaMFHg74A==',key_name='tempest-keypair-1667210968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44d92f0c85bd4b20a76d315b1fff8f81',ramdisk_id='',reservation_id='r-oszakjqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2105497564',owner_user_name='tempest-SnapshotDataIntegrityTests-2105497564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4bd8164c6734205b8e41e74b0ce832e',uuid=50f5ddb7-07d4-46a4-8428-6558a0ffcc25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75257) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Converting VIF {"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=10c48d81-cc93-41f7-93b5-8ec30223a387,network=Network(c97f0d3b-1ac4-4af4-8224-eb7042bf8a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c48d81-cc') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.objects.instance [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'pci_devices' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] End _get_guest_xml xml=<domain type="kvm">
Nov 14 02:49:11 user nova-compute[75257]:   <uuid>50f5ddb7-07d4-46a4-8428-6558a0ffcc25</uuid>
Nov 14 02:49:11 user nova-compute[75257]:   <name>instance-00000035</name>
Nov 14 02:49:11 user nova-compute[75257]:   <memory>524288</memory>
Nov 14 02:49:11 user nova-compute[75257]:   <vcpu>1</vcpu>
Nov 14 02:49:11 user nova-compute[75257]:   <metadata>
Nov 14 02:49:11 user nova-compute[75257]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 02:49:11 user nova-compute[75257]:       <nova:package version="0.0.0"/>
Nov 14 02:49:11 user nova-compute[75257]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1804523011</nova:name>
Nov 14 02:49:11 user nova-compute[75257]:       <nova:creationTime>2023-11-14 02:49:11</nova:creationTime>
Nov 14 02:49:11 user nova-compute[75257]:       <nova:flavor name="m1.tiny">
Nov 14 02:49:11 user nova-compute[75257]:         <nova:memory>512</nova:memory>
Nov 14 02:49:11 user nova-compute[75257]:         <nova:disk>1</nova:disk>
Nov 14 02:49:11 user nova-compute[75257]:         <nova:swap>0</nova:swap>
Nov 14 02:49:11 user nova-compute[75257]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 02:49:11 user nova-compute[75257]:         <nova:vcpus>1</nova:vcpus>
Nov 14 02:49:11 user nova-compute[75257]:       </nova:flavor>
Nov 14 02:49:11 user nova-compute[75257]:       <nova:owner>
Nov 14 02:49:11 user nova-compute[75257]:         <nova:user uuid="b4bd8164c6734205b8e41e74b0ce832e">tempest-SnapshotDataIntegrityTests-2105497564-project-member</nova:user>
Nov 14 02:49:11 user nova-compute[75257]:         <nova:project uuid="44d92f0c85bd4b20a76d315b1fff8f81">tempest-SnapshotDataIntegrityTests-2105497564</nova:project>
Nov 14 02:49:11 user nova-compute[75257]:       </nova:owner>
Nov 14 02:49:11 user nova-compute[75257]:       <nova:root type="image" uuid="ccff493f-43f6-4683-9bdc-984e861f9bf9"/>
Nov 14 02:49:11 user nova-compute[75257]:       <nova:ports>
Nov 14 02:49:11 user nova-compute[75257]:         <nova:port uuid="10c48d81-cc93-41f7-93b5-8ec30223a387">
Nov 14 02:49:11 user nova-compute[75257]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 02:49:11 user nova-compute[75257]:         </nova:port>
Nov 14 02:49:11 user nova-compute[75257]:       </nova:ports>
Nov 14 02:49:11 user nova-compute[75257]:     </nova:instance>
Nov 14 02:49:11 user nova-compute[75257]:   </metadata>
Nov 14 02:49:11 user nova-compute[75257]:   <sysinfo type="smbios">
Nov 14 02:49:11 user nova-compute[75257]:     <system>
Nov 14 02:49:11 user nova-compute[75257]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 02:49:11 user nova-compute[75257]:       <entry name="product">OpenStack Nova</entry>
Nov 14 02:49:11 user nova-compute[75257]:       <entry name="version">0.0.0</entry>
Nov 14 02:49:11 user nova-compute[75257]:       <entry name="serial">50f5ddb7-07d4-46a4-8428-6558a0ffcc25</entry>
Nov 14 02:49:11 user nova-compute[75257]:       <entry name="uuid">50f5ddb7-07d4-46a4-8428-6558a0ffcc25</entry>
Nov 14 02:49:11 user nova-compute[75257]:       <entry name="family">Virtual Machine</entry>
Nov 14 02:49:11 user nova-compute[75257]:     </system>
Nov 14 02:49:11 user nova-compute[75257]:   </sysinfo>
Nov 14 02:49:11 user nova-compute[75257]:   <os>
Nov 14 02:49:11 user nova-compute[75257]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 02:49:11 user nova-compute[75257]:     <boot dev="hd"/>
Nov 14 02:49:11 user nova-compute[75257]:     <smbios mode="sysinfo"/>
Nov 14 02:49:11 user nova-compute[75257]:   </os>
Nov 14 02:49:11 user nova-compute[75257]:   <features>
Nov 14 02:49:11 user nova-compute[75257]:     <acpi/>
Nov 14 02:49:11 user nova-compute[75257]:     <apic/>
Nov 14 02:49:11 user nova-compute[75257]:     <vmcoreinfo/>
Nov 14 02:49:11 user nova-compute[75257]:   </features>
Nov 14 02:49:11 user nova-compute[75257]:   <clock offset="utc">
Nov 14 02:49:11 user nova-compute[75257]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 02:49:11 user nova-compute[75257]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 02:49:11 user nova-compute[75257]:     <timer name="hpet" present="no"/>
Nov 14 02:49:11 user nova-compute[75257]:   </clock>
Nov 14 02:49:11 user nova-compute[75257]:   <cpu mode="custom" match="exact">
Nov 14 02:49:11 user nova-compute[75257]:     <model>Nehalem</model>
Nov 14 02:49:11 user nova-compute[75257]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 02:49:11 user nova-compute[75257]:   </cpu>
Nov 14 02:49:11 user nova-compute[75257]:   <devices>
Nov 14 02:49:11 user nova-compute[75257]:     <disk type="file" device="disk">
Nov 14 02:49:11 user nova-compute[75257]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 02:49:11 user nova-compute[75257]:       <source file="/opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk"/>
Nov 14 02:49:11 user nova-compute[75257]:       <target dev="vda" bus="virtio"/>
Nov 14 02:49:11 user nova-compute[75257]:     </disk>
Nov 14 02:49:11 user nova-compute[75257]:     <interface type="ethernet">
Nov 14 02:49:11 user nova-compute[75257]:       <mac address="fa:16:3e:4f:89:0f"/>
Nov 14 02:49:11 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:49:11 user nova-compute[75257]:       <mtu size="1442"/>
Nov 14 02:49:11 user nova-compute[75257]:       <target dev="tap10c48d81-cc"/>
Nov 14 02:49:11 user nova-compute[75257]:     </interface>
Nov 14 02:49:11 user nova-compute[75257]:     <serial type="pty">
Nov 14 02:49:11 user nova-compute[75257]:       <log file="/opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/console.log" append="off"/>
Nov 14 02:49:11 user nova-compute[75257]:     </serial>
Nov 14 02:49:11 user nova-compute[75257]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 02:49:11 user nova-compute[75257]:     <video>
Nov 14 02:49:11 user nova-compute[75257]:       <model type="virtio"/>
Nov 14 02:49:11 user nova-compute[75257]:     </video>
Nov 14 02:49:11 user nova-compute[75257]:     <rng model="virtio">
Nov 14 02:49:11 user nova-compute[75257]:       <backend model="random">/dev/urandom</backend>
Nov 14 02:49:11 user nova-compute[75257]:     </rng>
Nov 14 02:49:11 user nova-compute[75257]:     <controller type="usb" index="0" model="none"/>
Nov 14 02:49:11 user nova-compute[75257]:     <memballoon model="virtio">
Nov 14 02:49:11 user nova-compute[75257]:       <stats period="10"/>
Nov 14 02:49:11 user nova-compute[75257]:     </memballoon>
Nov 14 02:49:11 user nova-compute[75257]:   </devices>
Nov 14 02:49:11 user nova-compute[75257]: </domain>
Nov 14 02:49:11 user nova-compute[75257]:  {{(pid=75257) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:49:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1804523011',display_name='tempest-SnapshotDataIntegrityTests-server-1804523011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1804523011',id=53,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/2/dChEzGh99fomls9GfeKvtqveWShI3UeXT2IxIahh0o6gchHk+4rIR33V5V196DsPnNW6gCOEJAbpSTc5tdg71kK0o80z4NtrbrY33vPOdAh40qhkOOrdLaMFHg74A==',key_name='tempest-keypair-1667210968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44d92f0c85bd4b20a76d315b1fff8f81',ramdisk_id='',reservation_id='r-oszakjqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2105497564',owner_user_name='tempest-SnapshotDataIntegrityTests-2105497564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T02:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4bd8164c6734205b8e41e74b0ce832e',uuid=50f5ddb7-07d4-46a4-8428-6558a0ffcc25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Converting VIF {"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=10c48d81-cc93-41f7-93b5-8ec30223a387,network=Network(c97f0d3b-1ac4-4af4-8224-eb7042bf8a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c48d81-cc') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG os_vif [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=10c48d81-cc93-41f7-93b5-8ec30223a387,network=Network(c97f0d3b-1ac4-4af4-8224-eb7042bf8a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c48d81-cc') {{(pid=75257) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65cf6326-fa1a-5d01-9bc7-e63052e6a29e', '_type': 'linux-noop'}}, row=False) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10c48d81-cc, may_exist=True, interface_attrs={}) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10c48d81-cc, col_values=(('qos', UUID('607e7e3f-af0f-4a83-ac3f-b56c1f8aa118')),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10c48d81-cc, col_values=(('external_ids', {'iface-id': '10c48d81-cc93-41f7-93b5-8ec30223a387', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:89:0f', 'vm-uuid': '50f5ddb7-07d4-46a4-8428-6558a0ffcc25'}),), if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:11 user nova-compute[75257]: INFO os_vif [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=10c48d81-cc93-41f7-93b5-8ec30223a387,network=Network(c97f0d3b-1ac4-4af4-8224-eb7042bf8a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c48d81-cc')
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No VIF found with MAC fa:16:3e:4f:89:0f, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updated VIF entry in instance network info cache for port 10c48d81-cc93-41f7-93b5-8ec30223a387. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG nova.network.neutron [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:49:11 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-7ca34cdb-313d-42da-a95e-82700567f1da req-83d4f252-9894-42e5-8d8d-7db4d02556ea service nova] Releasing lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:49:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received event network-vif-plugged-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:49:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:49:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:49:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:49:13 user nova-compute[75257]: DEBUG nova.compute.manager [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] No waiting events found dispatching network-vif-plugged-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:49:13 user nova-compute[75257]: WARNING nova.compute.manager [req-95ee41c4-ed6a-45c2-9036-1536d10755ad req-db99d734-261f-41a4-a1ec-91d610b8b88b service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received unexpected event network-vif-plugged-10c48d81-cc93-41f7-93b5-8ec30223a387 for instance with vm_state building and task_state spawning.
Nov 14 02:49:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Instance event wait completed in 0 seconds for  {{(pid=75257) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Guest created on hypervisor {{(pid=75257) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 02:49:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Instance spawned successfully.
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Found default for hw_cdrom_bus of ide {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Found default for hw_disk_bus of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Found default for hw_input_bus of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Found default for hw_pointer_model of None {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Found default for hw_video_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Found default for hw_vif_model of virtio {{(pid=75257) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 02:49:15 user nova-compute[75257]: INFO nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Checking state {{(pid=75257) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 02:49:15 user nova-compute[75257]: INFO nova.compute.manager [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Took 7.17 seconds to build instance.
Nov 14 02:49:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-652a65a6-a10c-4789-99a6-b4b98f20f989 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.289s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received event network-vif-plugged-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:49:15 user nova-compute[75257]: DEBUG nova.compute.manager [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] No waiting events found dispatching network-vif-plugged-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:49:15 user nova-compute[75257]: WARNING nova.compute.manager [req-384894b8-e501-4573-be20-b7a61f0f6d1d req-4cd70987-766a-4031-ad6b-2eb58073e201 service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received unexpected event network-vif-plugged-10c48d81-cc93-41f7-93b5-8ec30223a387 for instance with vm_state active and task_state None.
Nov 14 02:49:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:49:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:49:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:49:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:49:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:49:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:49:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:27 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:49:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:28 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:49:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:49:28 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:49:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:49:28 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:49:28 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:49:28 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:49:29 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:49:29 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:49:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:49:29 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:49:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:49:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:31 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:49:32 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:49:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:49:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:49:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:49:32 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:49:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:49:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:49:32 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:49:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:49:33 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:49:33 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:49:33 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=25.060855865478516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:49:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:49:34 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:49:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:49:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:49:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:49:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:50:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:50:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:50:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:50:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:50:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:50:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:50:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:50:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:50:29 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:29 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:29 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:50:30 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:30 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:50:30 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:50:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:50:30 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:50:30 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:50:30 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:50:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:50:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:50:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:50:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:50:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:50:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:50:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:50:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:33 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:34 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:34 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:50:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:50:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:50:34 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:50:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:50:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:50:34 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:50:35 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:50:35 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:50:35 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=25.058433532714844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:50:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:50:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:50:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:50:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:50:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:50:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:50:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:47 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:50:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:50:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:50:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received event network-changed-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:50:59 user nova-compute[75257]: DEBUG nova.compute.manager [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Refreshing instance network info cache due to event network-changed-10c48d81-cc93-41f7-93b5-8ec30223a387. {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 02:50:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] Acquiring lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:50:59 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] Acquired lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:50:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Refreshing network info cache for port 10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 02:50:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updated VIF entry in instance network info cache for port 10c48d81-cc93-41f7-93b5-8ec30223a387. {{(pid=75257) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 02:50:59 user nova-compute[75257]: DEBUG nova.network.neutron [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:51:00 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-df504735-2dc9-4ecc-a6d2-b65727aa3704 req-535a893c-4705-43f6-b424-44480fe01657 service nova] Releasing lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:51:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:51:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:51:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:51:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:51:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:51:01 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:51:01 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:51:02 user nova-compute[75257]: INFO nova.compute.manager [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attaching volume 804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb to /dev/vdb
Nov 14 02:51:02 user nova-compute[75257]: DEBUG os_brick.utils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0522c721-bf8b-422f-a8b8-34d9721ba807]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9622f6-6e33-494d-9309-7a59b1aee59f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe89a7d-c8d1-4a7a-a76c-59347f14e0db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed4ffce-0fa1-49af-ba19-5f2997e71655]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:51:02 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:51:02 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e335aee9-c249-440a-92eb-447ed455746e]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG os_brick.utils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating existing volume attachment record: fb35f43e-f578-4954-abde-d68e18bc7d65 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:51:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAoDtxyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:51:06 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:51:06 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:51:06 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[20060def-405b-4131-bbe1-b85c367f9617]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:51:06 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1185f0-f896-40f0-87b4-cd9f6bf55b51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb] added
Nov 14 02:51:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69070d2-95b8-4351-ab56-81187e43e02b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a423c24-5bfc-45c6-890c-6d61b52cd133]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAoDtxyG {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAoDtxyG" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c9a8e6-6c63-44be-8f33-8a8ff4974aff]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JAoDtxyG'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79b5e81-c410-43f4-b85d-ab093457d9e6]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48f97a0-c2dc-487c-816d-71999adb8d36]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:51:06 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:51:06 user nova-compute[75257]:  {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:51:06 user nova-compute[75257]: WARNING os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 02:51:06 user nova-compute[75257]: 
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c3768d-3ede-47ff-a37d-666169d26bd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb, portal: 172.16.0.220,3260]
Nov 14 02:51:06 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb, portal: 172.16.0.220,3260] successful.
Nov 14 02:51:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98d41fb-b8ea-4a14-9295-3a8ae2890ff2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fdcc6a-0916-4cbd-a242-98ee68d2c397]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb (non-flash)
Nov 14 02:51:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb (non-flash)
Nov 14 02:51:06 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e39cee-4bf3-47de-bcad-f899f79fdc58]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:51:06 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAoDtxyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:51:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:51:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26133653064373863', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:51:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133653064373863', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:51:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:51:07 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:51:07 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:51:07 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:51:07 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:51:07 user nova-compute[75257]:   <serial>804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb</serial>
Nov 14 02:51:07 user nova-compute[75257]: </disk>
Nov 14 02:51:07 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:51:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:51:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:51:08 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No VIF found with MAC fa:16:3e:4f:89:0f, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:51:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-f4b9e1af-4124-463e-b6a8-3d4374956b17 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.262s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:51:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:51:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:51:15 user nova-compute[75257]: INFO nova.compute.manager [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Detaching volume 804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb
Nov 14 02:51:15 user nova-compute[75257]: INFO nova.virt.block_device [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attempting to driver detach volume 804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb from mountpoint /dev/vdb
Nov 14 02:51:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Attempting to detach device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:51:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:51:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:51:15 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:51:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:51:15 user nova-compute[75257]:   <serial>804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb</serial>
Nov 14 02:51:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:51:15 user nova-compute[75257]: </disk>
Nov 14 02:51:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:51:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully detached device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the persistent domain config.
Nov 14 02:51:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:51:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:51:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:51:15 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:51:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:51:15 user nova-compute[75257]:   <serial>804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb</serial>
Nov 14 02:51:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:51:15 user nova-compute[75257]: </disk>
Nov 14 02:51:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:51:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:51:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:18 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:51:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:51:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:51:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:30 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:51:31 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:51:32 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:51:32 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:51:32 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:51:32 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:51:32 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:51:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:51:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:51:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:51:36 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 is timed out.
Nov 14 02:51:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully detached device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the live domain config.
Nov 14 02:51:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAoDtxyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:51:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b698ad-a43d-46fe-81f5-6c93a87eb388]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:51:36 user nova-compute[75257]: No targets found.
Nov 14 02:51:36 user nova-compute[75257]: iSNS:
Nov 14 02:51:36 user nova-compute[75257]: No targets found.
Nov 14 02:51:36 user nova-compute[75257]: STATIC:
Nov 14 02:51:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb
Nov 14 02:51:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:51:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:51:36 user nova-compute[75257]: FIRMWARE:
Nov 14 02:51:36 user nova-compute[75257]: No targets found.
Nov 14 02:51:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:51:36 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:51:36 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe8a1c1-f784-491d-9482-e74cab001e18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad11bb71-856e-4850-afc3-3a1c2c5703e6]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb (non-flash)
Nov 14 02:51:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb (non-flash)
Nov 14 02:51:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb978704790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1bc198-2667-47a6-a350-efd0523391c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[71238b87-c558-49bd-8692-871a257d617a]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[65880648-1ea4-46b0-95c0-a808c5d230a1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc19a30d-6ae6-4b7e-b543-15704183f509]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ae2cf-38e6-4f1b-b0fb-e4dbab021b45]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1469ee42-6bfe-42e9-a0e1-d7ab1c057b33]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb, portal: 172.16.0.220,3260]
Nov 14 02:51:36 user nova-compute[75257]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb, portal: 172.16.0.220,3260] successful.
Nov 14 02:51:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:804c13e7-bd8b-4dc0-a55a-bfa3f4aafffb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b206b083-29db-449f-9f71-2fc9c8368518]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== disconnect_volume: return (295ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:51:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:51:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:51:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=25.05712127685547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-657f8180-5b93-4ea6-b892-de9290b8fab2 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.955s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:51:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:51:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:51:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:51:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:51:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:51:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:51:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:51:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:51:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:52:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:52:07 user nova-compute[75257]: INFO nova.compute.manager [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attaching volume ac551123-c7fc-4818-a6fa-3d5ab8c12c31 to /dev/vdb
Nov 14 02:52:07 user nova-compute[75257]: DEBUG os_brick.utils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6649609-64ae-42c5-9129-61d4bdba6775]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bfbe5a-5ef7-4a81-adb3-c75fedae94ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5828f6-1c0b-414c-affd-51f15b1594e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[785f9ce3-3aec-4d9e-be17-a64732c82a3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:52:07 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:52:07 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[648a4335-92de-4b6d-a243-739128397e9e]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG os_brick.utils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating existing volume attachment record: d504632b-c111-4c1c-913a-d5cc7f3b0014 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:52:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:11 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:52:11 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmQNiFAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:52:11 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:52:11 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:52:11 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:52:11 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:52:11 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:52:11 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:52:11 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:52:11 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064f213-6f0e-4680-a6ab-d8a0df77a877]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:52:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[654b7404-412f-4929-a76a-784a1e4a39d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31] added
Nov 14 02:52:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b6d702-8a96-4a8b-80c1-818e22c14a06]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da7d75d-e876-4ffe-ae91-d8d78c14b7a1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmQNiFAa {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmQNiFAa" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[50828887-de61-4dd6-b4fa-505a5290f42b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pmQNiFAa'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd44def-d488-4299-9608-d6c0b4c04880]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[915dd6ed-8c14-4ea1-82aa-cef74a77f1c7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:52:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:52:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:52:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 02:52:12 user nova-compute[75257]: 
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a6c041-a5f3-4839-8d8c-25b7307d78d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31, portal: 172.16.0.220,3260]
Nov 14 02:52:12 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31, portal: 172.16.0.220,3260] successful.
Nov 14 02:52:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ddbf49-de72-497e-b340-b432e5a63ea8]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb61c31c-afa3-4722-919c-e098e00b3f50]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 (non-flash)
Nov 14 02:52:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 (non-flash)
Nov 14 02:52:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd1fa0-f775-4f1d-920e-960590c62cae]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:52:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmQNiFAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:52:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:52:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '23437323230376536', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:52:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437323230376536', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:52:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:52:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:52:13 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:52:13 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:52:13 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:52:13 user nova-compute[75257]:   <serial>ac551123-c7fc-4818-a6fa-3d5ab8c12c31</serial>
Nov 14 02:52:13 user nova-compute[75257]: </disk>
Nov 14 02:52:13 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:52:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:52:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:52:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No VIF found with MAC fa:16:3e:4f:89:0f, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:52:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-14ffc0c4-cf2e-4a30-9b93-73747f6cb558 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.041s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:52:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:52:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:52:15 user nova-compute[75257]: INFO nova.compute.manager [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Detaching volume ac551123-c7fc-4818-a6fa-3d5ab8c12c31
Nov 14 02:52:15 user nova-compute[75257]: INFO nova.virt.block_device [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attempting to driver detach volume ac551123-c7fc-4818-a6fa-3d5ab8c12c31 from mountpoint /dev/vdb
Nov 14 02:52:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Attempting to detach device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:52:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:52:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:52:15 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:52:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:52:15 user nova-compute[75257]:   <serial>ac551123-c7fc-4818-a6fa-3d5ab8c12c31</serial>
Nov 14 02:52:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:52:15 user nova-compute[75257]: </disk>
Nov 14 02:52:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:52:15 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully detached device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the persistent domain config.
Nov 14 02:52:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:52:15 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:52:15 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:52:15 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:52:15 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:52:15 user nova-compute[75257]:   <serial>ac551123-c7fc-4818-a6fa-3d5ab8c12c31</serial>
Nov 14 02:52:15 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:52:15 user nova-compute[75257]: </disk>
Nov 14 02:52:15 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:52:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:52:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:52:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:30 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:52:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:52:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:52:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:52:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:52:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:31 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:52:33 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:33 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:52:33 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:52:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:52:33 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:52:33 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:52:33 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:52:34 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:52:34 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:52:34 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:52:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:36 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 is timed out.
Nov 14 02:52:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully detached device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the live domain config.
Nov 14 02:52:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmQNiFAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:52:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b70644d-eed9-4be3-8ac5-ab5295a34ba3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:52:36 user nova-compute[75257]: No targets found.
Nov 14 02:52:36 user nova-compute[75257]: iSNS:
Nov 14 02:52:36 user nova-compute[75257]: No targets found.
Nov 14 02:52:36 user nova-compute[75257]: STATIC:
Nov 14 02:52:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31
Nov 14 02:52:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:52:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:52:36 user nova-compute[75257]: FIRMWARE:
Nov 14 02:52:36 user nova-compute[75257]: No targets found.
Nov 14 02:52:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:52:36 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:52:36 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90133b8-7579-4ec4-8707-7001577407ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d204db-0110-4079-90a9-3bde2e3e1753]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 (non-flash)
Nov 14 02:52:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 (non-flash)
Nov 14 02:52:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c39e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[354bdaa7-17f6-412b-981e-a64beab8d203]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b728ff6e-a3b3-4cc7-9f97-93cdd493df60]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a794b4-9705-4515-9f46-10f0505081d2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d5d8b8-724d-4e63-8f1c-2885439f8d59]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22a219e-f06a-405b-922e-06b69f59c1ae]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb780747-9fb4-4664-b16e-13ba006e4e2d]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31, portal: 172.16.0.220,3260]
Nov 14 02:52:36 user nova-compute[75257]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31, portal: 172.16.0.220,3260] successful.
Nov 14 02:52:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac551123-c7fc-4818-a6fa-3d5ab8c12c31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bca8f9a-9193-40d8-9b03-c7f9f41fc4e2]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== disconnect_volume: return (306ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:52:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:52:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:52:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.05620574951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-b4e4803e-812a-4991-bfcb-4b9ec6239183 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.816s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing inventories for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating ProviderTree inventory for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Updating inventory in ProviderTree for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing aggregate associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, aggregates: None {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 02:52:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Refreshing trait associations for resource provider d089fce4-28ce-4f05-848e-0c103c9d96c6, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=75257) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 02:52:38 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:52:38 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:52:38 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:52:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:52:38 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:38 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:52:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:52:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:52:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:52:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:52:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:50 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:52:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:52:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:52:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:52:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:52:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:52:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:53:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:07 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:07 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75257) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 02:53:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:53:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:53:07 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:53:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:53:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:53:07 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:53:07 user nova-compute[75257]: INFO nova.compute.manager [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attaching volume 06e9a2ba-7ae9-427c-a96b-d58138eede47 to /dev/vdb
Nov 14 02:53:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG os_brick.utils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e4668-ee90-4072-9143-a5b0d9ef886a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab85e6-ccee-45ee-9172-46efe19c84a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f40d74-c70f-4f3e-94cc-7df621bfd579]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae84ce9c-95d9-4f2f-8342-523ac94a9e52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:53:08 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f3eb0f-537a-4836-9246-794a8bb9343b]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG os_brick.utils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating existing volume attachment record: 64d1d3b4-ac64-426c-bee8-82cb9ef6992b {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Triggering sync for uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 02:53:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:53:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzRkJjdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:53:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:53:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:53:12 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9c0237-0010-4484-8267-84c6d68ee86c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:53:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab5f335-8bd5-43a4-a9ec-10290899bc97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47] added
Nov 14 02:53:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[819da899-1e83-461d-947b-98c994196d3d]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[26314636-aa64-4460-b4f4-4431b5a496ae]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzRkJjdg {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzRkJjdg" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb820734-c92f-400c-91f4-30d11ad303bd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzRkJjdg'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f593070-2df0-4278-9440-d5be52292af5]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f561210e-cc47-4103-b1a3-4fa10f6c0232]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:53:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:53:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:53:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 02:53:12 user nova-compute[75257]: 
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb21d46-aea2-484a-9984-ab51eae66bbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47, portal: 172.16.0.220,3260]
Nov 14 02:53:12 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47, portal: 172.16.0.220,3260] successful.
Nov 14 02:53:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f85bf39-e583-48e6-8da2-bae5e29e6f9f]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95b936c-74bc-47f2-a364-5e364bd0b491]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 (non-flash)
Nov 14 02:53:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 (non-flash)
Nov 14 02:53:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb723f4a-6735-4b1e-8849-4294cac04370]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzRkJjdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23233663363313238', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233663363313238', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:53:13 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:53:13 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:53:13 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:53:13 user nova-compute[75257]:   <serial>06e9a2ba-7ae9-427c-a96b-d58138eede47</serial>
Nov 14 02:53:13 user nova-compute[75257]: </disk>
Nov 14 02:53:13 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No VIF found with MAC fa:16:3e:4f:89:0f, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-ee67703d-c5b6-42e1-b78b-1dbddbf0ac65 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.975s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.079s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:53:13 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:53:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:53:15 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:53:16 user nova-compute[75257]: INFO nova.compute.manager [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Detaching volume 06e9a2ba-7ae9-427c-a96b-d58138eede47
Nov 14 02:53:16 user nova-compute[75257]: INFO nova.virt.block_device [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attempting to driver detach volume 06e9a2ba-7ae9-427c-a96b-d58138eede47 from mountpoint /dev/vdb
Nov 14 02:53:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Attempting to detach device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:53:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:53:16 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:53:16 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:53:16 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:53:16 user nova-compute[75257]:   <serial>06e9a2ba-7ae9-427c-a96b-d58138eede47</serial>
Nov 14 02:53:16 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:53:16 user nova-compute[75257]: </disk>
Nov 14 02:53:16 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:53:16 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully detached device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the persistent domain config.
Nov 14 02:53:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:53:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:53:16 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:53:16 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:53:16 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:53:16 user nova-compute[75257]:   <serial>06e9a2ba-7ae9-427c-a96b-d58138eede47</serial>
Nov 14 02:53:16 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:53:16 user nova-compute[75257]: </disk>
Nov 14 02:53:16 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:53:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:53:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:53:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:53:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:53:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:53:17 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Cleaning up deleted instances {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 02:53:17 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] There are 0 instances to clean {{(pid=75257) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 02:53:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:20 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:53:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:53:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:53:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:53:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:53:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:31 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:31 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:31 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:53:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:53:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:53:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:53:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:53:35 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:53:35 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:53:36 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 is timed out.
Nov 14 02:53:36 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully detached device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the live domain config.
Nov 14 02:53:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzRkJjdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:53:36 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8688d658-98e8-459a-b170-67ac175442e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:53:36 user nova-compute[75257]: No targets found.
Nov 14 02:53:36 user nova-compute[75257]: iSNS:
Nov 14 02:53:36 user nova-compute[75257]: No targets found.
Nov 14 02:53:36 user nova-compute[75257]: STATIC:
Nov 14 02:53:36 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47
Nov 14 02:53:36 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:53:36 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:53:36 user nova-compute[75257]: FIRMWARE:
Nov 14 02:53:36 user nova-compute[75257]: No targets found.
Nov 14 02:53:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:53:36 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:53:36 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2484bd79-b44c-4a09-9e2e-cef0b711e77c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3672e3cf-3b51-4b85-8dfa-373a464dc3b8]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 (non-flash)
Nov 14 02:53:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 (non-flash)
Nov 14 02:53:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c171900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351857f-d0cc-452f-b79b-0fcf6f5e7de0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1883aa7-6a98-45e9-bfb0-31d82bdc66ee]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adef464-277b-43a9-b79a-3fe669c23543]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9672e995-e4e6-43e7-a6ad-5d2b97b78fb7]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[53673e38-1493-4073-a3cd-28fafe4a6ae1]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5038aa9a-2910-4140-9f28-e9c786e00103]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47, portal: 172.16.0.220,3260]
Nov 14 02:53:36 user nova-compute[75257]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47, portal: 172.16.0.220,3260] successful.
Nov 14 02:53:36 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e9a2ba-7ae9-427c-a96b-d58138eede47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[72214cba-288e-4b25-ae8d-e29bc67a6423]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== disconnect_volume: return (277ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:53:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:53:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:53:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=25.055217742919922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG nova.objects.instance [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-8de94567-3678-400f-a1b5-2a24a36918d1 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.590s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:53:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:53:38 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:39 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:53:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:53:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:53:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:53:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:53:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:53:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:53:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:53:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:53:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:53:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:53:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:53:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:54:08 user nova-compute[75257]: INFO nova.compute.manager [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attaching volume 383c4a34-db76-48e2-843a-7fac96796096 to /dev/vdb
Nov 14 02:54:08 user nova-compute[75257]: DEBUG os_brick.utils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d30e2f2-9c70-4a3a-a59c-791a57b8f315]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a51d545a719\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb2b3ee-e104-4738-8eef-3b497f1943f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[67480c84-6420-4651-b7b6-84780f463ac3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8c755-3eb7-4b69-89a3-4ebe58041e67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Running cmd (subprocess): nvme version {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] 'nvme version' failed. Not Retrying. {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] nvme not present on system {{(pid=75257) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 02:54:08 user nova-compute[75257]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 02:54:08 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c126845-3db4-425f-bcad-2c6806905801]: (4, '') {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75257) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.lightos [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] LIGHTOS: no hostnqn found. {{(pid=75257) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG os_brick.utils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a51d545a719', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:54:08 user nova-compute[75257]: DEBUG nova.virt.block_device [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating existing volume attachment record: 096f8517-e2ca-4b33-8295-fc417fb3fc41 {{(pid=75257) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 02:54:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Calling os-brick to attach iSCSI Volume {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zPActxZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:54:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:54:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:54:12 user nova-compute[75257]: INFO os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c6e69-64da-4724-b17b-16d2d23a8b9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 02:54:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --interface default --op new {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4aa3e5-b7b4-471c-9a56-9fda7237b64c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096] added\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096] added
Nov 14 02:54:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff52f04-9e6d-49c3-9f12-51cc4d8e6d05]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dd817d-b4a1-4976-ae2f-8e9f9dfa1674]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zPActxZn {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zPActxZn" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[333f37ee-843b-467d-b6b8-90712b7543ee]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zPActxZn'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.154s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[7308be60-399e-4075-bbb1-4722204c682b]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[627667a9-cfc9-4848-95ae-271a530aaa21]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:54:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 02:54:12 user nova-compute[75257]:  {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:54:12 user nova-compute[75257]: WARNING os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 02:54:12 user nova-compute[75257]: 
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --login {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4c451d-f03d-4893-bc2c-b0a778642518]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096, portal: 172.16.0.220,3260]
Nov 14 02:54:12 user nova-compute[75257]: Login to [iface: default, target: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096, portal: 172.16.0.220,3260] successful.
Nov 14 02:54:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52bcb8b-8824-47de-b210-617452f84dbd]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[308f9e42-1baf-4151-bb31-c7d840624e1f]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 (non-flash)
Nov 14 02:54:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 (non-flash)
Nov 14 02:54:12 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Connected to 172.16.0.220:3260 {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75257) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75257) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[29be0de6-d1d2-46ae-811c-4b339276d7cd]: (4, ('- - 0', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75257) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 02:54:12 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zPActxZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75257) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 02:54:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:54:13 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26334656462626132', 'path': '/dev/sdb'} {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:54:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334656462626132', 'path': '/dev/sdb'} {{(pid=75257) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 02:54:13 user nova-compute[75257]: DEBUG nova.objects.instance [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:54:13 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 02:54:13 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:54:13 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:54:13 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:54:13 user nova-compute[75257]:   <serial>383c4a34-db76-48e2-843a-7fac96796096</serial>
Nov 14 02:54:13 user nova-compute[75257]: </disk>
Nov 14 02:54:13 user nova-compute[75257]:  {{(pid=75257) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 02:54:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No BDM found with device name vda, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:54:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75257) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 02:54:14 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] No VIF found with MAC fa:16:3e:4f:89:0f, not building metadata {{(pid=75257) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 02:54:14 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-6c9f5848-873a-447f-ba19-2f96e07ecb77 tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.093s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:54:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:54:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:54:16 user nova-compute[75257]: INFO nova.compute.manager [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Detaching volume 383c4a34-db76-48e2-843a-7fac96796096
Nov 14 02:54:16 user nova-compute[75257]: INFO nova.virt.block_device [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Attempting to driver detach volume 383c4a34-db76-48e2-843a-7fac96796096 from mountpoint /dev/vdb
Nov 14 02:54:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Attempting to detach device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the persistent domain config. {{(pid=75257) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 02:54:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:54:16 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:54:16 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:54:16 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:54:16 user nova-compute[75257]:   <serial>383c4a34-db76-48e2-843a-7fac96796096</serial>
Nov 14 02:54:16 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:54:16 user nova-compute[75257]: </disk>
Nov 14 02:54:16 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:54:16 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully detached device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the persistent domain config.
Nov 14 02:54:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the live domain config. {{(pid=75257) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 02:54:16 user nova-compute[75257]: DEBUG nova.virt.libvirt.guest [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 02:54:16 user nova-compute[75257]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 02:54:16 user nova-compute[75257]:   <source dev="/dev/sdb"/>
Nov 14 02:54:16 user nova-compute[75257]:   <target dev="vdb" bus="virtio"/>
Nov 14 02:54:16 user nova-compute[75257]:   <serial>383c4a34-db76-48e2-843a-7fac96796096</serial>
Nov 14 02:54:16 user nova-compute[75257]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 02:54:16 user nova-compute[75257]: </disk>
Nov 14 02:54:16 user nova-compute[75257]:  {{(pid=75257) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 02:54:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.driver [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 02:54:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:21 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:21 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:26 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:31 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:33 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:33 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:33 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:54:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:54:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:54:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 02:54:35 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquired lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 02:54:35 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Forcefully refreshing network info cache for instance {{(pid=75257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 02:54:35 user nova-compute[75257]: DEBUG nova.objects.instance [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lazy-loading 'info_cache' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG nova.network.neutron [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [{"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Releasing lock "refresh_cache-50f5ddb7-07d4-46a4-8428-6558a0ffcc25" {{(pid=75257) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updated the network info_cache for instance {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:36 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 is timed out.
Nov 14 02:54:37 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully detached device vdb from instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 from the live domain config.
Nov 14 02:54:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:54:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:54:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.054298400878906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] calling os-brick to detach iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb9a4157580>, {'target_iqn': 'iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zPActxZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 02:54:37 user nova-compute[75257]: WARNING os_brick.initiator.connectors.base [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7d8c41-a91f-4406-9557-472c7a565e78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 02:54:37 user nova-compute[75257]: No targets found.
Nov 14 02:54:37 user nova-compute[75257]: iSNS:
Nov 14 02:54:37 user nova-compute[75257]: No targets found.
Nov 14 02:54:37 user nova-compute[75257]: STATIC:
Nov 14 02:54:37 user nova-compute[75257]: Target: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096
Nov 14 02:54:37 user nova-compute[75257]:         Portal: 172.16.0.220:3260,-1
Nov 14 02:54:37 user nova-compute[75257]:                 Iface Name: default
Nov 14 02:54:37 user nova-compute[75257]: FIRMWARE:
Nov 14 02:54:37 user nova-compute[75257]: No targets found.
Nov 14 02:54:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 02:54:37 user nova-compute[75257]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 02:54:37 user nova-compute[75257]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75257) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096', 0)] {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[834fd457-73b2-47b1-994c-13e1858c5aa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f4239-a427-4870-8d6a-4be51628938e]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 (non-flash)\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 (non-flash)
Nov 14 02:54:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 (non-flash)
Nov 14 02:54:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb99c2d9a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096'): ({'sdb'}, set())}) {{(pid=75257) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Removing single pathed devices sdb {{(pid=75257) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75257) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd8370e-b2a5-481a-b6bf-9fbe97e6a70b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7987b0b-b896-4792-bec9-e07275b28c88]: (4, ('ok\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Flushing IO for device /dev/sdb {{(pid=75257) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[1849d71b-0c9e-4b66-8f9e-864110cef9d8]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75257) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bd5d57-c1c2-4eb3-a26e-a684ff9e09c4]: (4, ('1', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.linuxscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] SCSI volumes sdb have been removed. {{(pid=75257) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096')] {{(pid=75257) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14d120-232b-460c-aa68-9a6057f257bb]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --logout {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b4d46f-d73e-4804-a266-051258220221]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096, portal: 172.16.0.220,3260]
Nov 14 02:54:37 user nova-compute[75257]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096, portal: 172.16.0.220,3260] successful.
Nov 14 02:54:37 user nova-compute[75257]:  stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op delete {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383c4a34-db76-48e2-843a-7fac96796096 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85764) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG oslo.privsep.daemon [-] privsep: reply[775972c1-cdee-4c06-a269-3a10aa138d47]: (4, ('', '')) {{(pid=85764) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75257) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.base [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] <== disconnect_volume: return (278ms) None {{(pid=75257) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 02:54:37 user nova-compute[75257]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Disconnected iSCSI Volume {{(pid=75257) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 02:54:38 user nova-compute[75257]: DEBUG nova.objects.instance [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'flavor' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:54:38 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-512cf7dd-0e56-48f0-9d6d-75efed42198e tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.649s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:54:38 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:38 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:41 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:54:41 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:54:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:54:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:54:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:54:46 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:54:51 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:54:52 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:54:56 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:01 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:06 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:11 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:55:16 user nova-compute[75257]: INFO nova.compute.manager [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Terminating instance
Nov 14 02:55:16 user nova-compute[75257]: DEBUG nova.compute.manager [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Start destroying the instance on the hypervisor. {{(pid=75257) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:16 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received event network-vif-unplugged-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] No waiting events found dispatching network-vif-unplugged-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG nova.compute.manager [req-9fe5b934-3956-4ff1-858d-1819216471e3 req-fbf14577-78ec-472e-9494-370f8b1ffabd service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received event network-vif-unplugged-10c48d81-cc93-41f7-93b5-8ec30223a387 for instance with task_state deleting. {{(pid=75257) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:17 user nova-compute[75257]: INFO nova.virt.libvirt.driver [-] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Instance destroyed successfully.
Nov 14 02:55:17 user nova-compute[75257]: DEBUG nova.objects.instance [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lazy-loading 'resources' on Instance uuid 50f5ddb7-07d4-46a4-8428-6558a0ffcc25 {{(pid=75257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG nova.virt.libvirt.vif [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T02:49:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1804523011',display_name='tempest-SnapshotDataIntegrityTests-server-1804523011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1804523011',id=53,image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/2/dChEzGh99fomls9GfeKvtqveWShI3UeXT2IxIahh0o6gchHk+4rIR33V5V196DsPnNW6gCOEJAbpSTc5tdg71kK0o80z4NtrbrY33vPOdAh40qhkOOrdLaMFHg74A==',key_name='tempest-keypair-1667210968',keypairs=<?>,launch_index=0,launched_at=2023-11-14T02:49:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44d92f0c85bd4b20a76d315b1fff8f81',ramdisk_id='',reservation_id='r-oszakjqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ccff493f-43f6-4683-9bdc-984e861f9bf9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2105497564',owner_user_name='tempest-SnapshotDataIntegrityTests-2105497564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T02:49:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4bd8164c6734205b8e41e74b0ce832e',uuid=50f5ddb7-07d4-46a4-8428-6558a0ffcc25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Converting VIF {"id": "10c48d81-cc93-41f7-93b5-8ec30223a387", "address": "fa:16:3e:4f:89:0f", "network": {"id": "c97f0d3b-1ac4-4af4-8224-eb7042bf8a92", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151272052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44d92f0c85bd4b20a76d315b1fff8f81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10c48d81-cc", "ovs_interfaceid": "10c48d81-cc93-41f7-93b5-8ec30223a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG nova.network.os_vif_util [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=10c48d81-cc93-41f7-93b5-8ec30223a387,network=Network(c97f0d3b-1ac4-4af4-8224-eb7042bf8a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c48d81-cc') {{(pid=75257) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG os_vif [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=10c48d81-cc93-41f7-93b5-8ec30223a387,network=Network(c97f0d3b-1ac4-4af4-8224-eb7042bf8a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c48d81-cc') {{(pid=75257) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10c48d81-cc, bridge=br-int, if_exists=True) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=607e7e3f-af0f-4a83-ac3f-b56c1f8aa118) {{(pid=75257) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:17 user nova-compute[75257]: INFO os_vif [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:89:0f,bridge_name='br-int',has_traffic_filtering=True,id=10c48d81-cc93-41f7-93b5-8ec30223a387,network=Network(c97f0d3b-1ac4-4af4-8224-eb7042bf8a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10c48d81-cc')
Nov 14 02:55:17 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Deleting instance files /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25_del
Nov 14 02:55:17 user nova-compute[75257]: INFO nova.virt.libvirt.driver [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Deletion of /opt/stack/data/nova/instances/50f5ddb7-07d4-46a4-8428-6558a0ffcc25_del complete
Nov 14 02:55:17 user nova-compute[75257]: INFO nova.compute.manager [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 02:55:17 user nova-compute[75257]: DEBUG oslo.service.loopingcall [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75257) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG nova.compute.manager [-] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Deallocating network for instance {{(pid=75257) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 02:55:17 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] deallocate_for_instance() {{(pid=75257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG nova.network.neutron [-] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Updating instance_info_cache with network_info: [] {{(pid=75257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 02:55:18 user nova-compute[75257]: INFO nova.compute.manager [-] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Took 1.07 seconds to deallocate network for instance.
Nov 14 02:55:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG nova.compute.manager [req-ce89bfa4-e0fe-4cc1-a6c2-023622473efa req-b9dd69f4-9bc7-4b68-a47b-b625497e1831 service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received event network-vif-deleted-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:55:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:55:18 user nova-compute[75257]: INFO nova.scheduler.client.report [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Deleted allocations for instance 50f5ddb7-07d4-46a4-8428-6558a0ffcc25
Nov 14 02:55:18 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-770da8f0-728b-4ba7-adf5-82f062d31fde tempest-SnapshotDataIntegrityTests-2105497564 tempest-SnapshotDataIntegrityTests-2105497564-project-member] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.268s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:55:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received event network-vif-plugged-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 02:55:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] Acquiring lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:55:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:55:19 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] Lock "50f5ddb7-07d4-46a4-8428-6558a0ffcc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:55:19 user nova-compute[75257]: DEBUG nova.compute.manager [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] No waiting events found dispatching network-vif-plugged-10c48d81-cc93-41f7-93b5-8ec30223a387 {{(pid=75257) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 02:55:19 user nova-compute[75257]: WARNING nova.compute.manager [req-d32610ad-4e6c-4ed9-996c-e12dcdd830f1 req-714824d3-5e15-48be-9f09-a07063ccba0b service nova] [instance: 50f5ddb7-07d4-46a4-8428-6558a0ffcc25] Received unexpected event network-vif-plugged-10c48d81-cc93-41f7-93b5-8ec30223a387 for instance with vm_state deleted and task_state None.
Nov 14 02:55:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:22 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:55:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:55:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:55:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:34 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:55:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:55:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:55:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:55:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:55:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:55:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:55:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:55:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:55:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:55:36 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:55:36 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Auditing locally available compute resources for user (node: user) {{(pid=75257) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 02:55:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:55:37 user nova-compute[75257]: WARNING nova.virt.libvirt.driver [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 02:55:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Hypervisor/Node resource view: name=user free_ram=9117MB free_disk=25.081375122070312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75257) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 02:55:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 02:55:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 02:55:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 02:55:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75257) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 02:55:37 user nova-compute[75257]: DEBUG nova.compute.provider_tree [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed in ProviderTree for provider: d089fce4-28ce-4f05-848e-0c103c9d96c6 {{(pid=75257) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 02:55:37 user nova-compute[75257]: DEBUG nova.scheduler.client.report [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Inventory has not changed for provider d089fce4-28ce-4f05-848e-0c103c9d96c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75257) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 02:55:37 user nova-compute[75257]: DEBUG nova.compute.resource_tracker [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Compute_service record updated for user:user {{(pid=75257) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 02:55:37 user nova-compute[75257]: DEBUG oslo_concurrency.lockutils [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75257) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 02:55:37 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:38 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:55:38 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:55:38 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:55:41 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:55:42 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:55:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:47 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:52 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:55:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:55:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75257) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 02:55:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75257) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 02:55:57 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:56:02 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:56:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:56:07 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:56:10 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:56:12 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:56:13 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:56:17 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:56:22 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:56:22 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:56:27 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 02:56:32 user nova-compute[75257]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75257) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 02:56:35 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:56:35 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75257) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 02:56:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 02:56:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Starting heal instance info cache {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 02:56:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Rebuilding the list of instances to heal {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 02:56:36 user nova-compute[75257]: DEBUG nova.compute.manager [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Didn't find any instances for network info cache update. {{(pid=75257) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 02:56:36 user nova-compute[75257]: DEBUG oslo_service.periodic_task [None req-cfbadb33-d1c6-47e1-953c-80bcc6797470 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75257) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}